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Abstract 



Ill-posed inverse problems arise in various scientific fields. We consider the signal 
detection problem for mildly, severely and extremely ill-posed inverse problems with l''- 
' ellipsoids (bodies) for Sobolev, analytic and generalized analytic classes of functions under 

. the Gaussian white noise model. We restrict our attention to the range q € (0,2], con- 

sisting of the "standard" case q = 2 and the "sparse" case q G (0,2), that has received 
considerable attention in the nonparametric estimation literature over the last decade, 
with the "sparse" case q € (0, 2) considered mostly in well-posed problems. We study 
both rate and sharp asymptotics for the error probabilities in the minimax setup. By 
' construction, however, the derived tests are, often, non-adaptive. In such cases, minimax 

rate-optimal adaptive tests of rather simple structure are also constructed. 

The above formulation and the results obtained are based on the singular value de- 
composition of the operator involved. We also consider the minimax signal detection 
problem for mildly ill-posed inverse problems with Besov classes (bodies) of functions 
Bg f., a > 0, q £ (0, oo), t £ {0,oo), that arises through the wavelet-vaguelette decom- 
position of a special class of homogeneous operators (such as integration or fractional 
integration). Restricting again our attention to the "sparse" case q G (0,2), both rate 
and sharp asymptotics for the error probabilities in the minimax setup are studied. Min- 
imax rate-optimal non-adaptive and adaptive tests are also constructed. 

Keywords: Analytic functions, Ill-posed inverse problems, Besov Spaces, Minimax test- 
ing. Singular value decomposition, Sobolev spaces. Wavelet- Vaguelette decomposition 
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1 Introduction 



We consider the detection problem in linear operator equations from noisy data under the 
assumption that the singular values of the operator decrease polynomial, exponential or 
power-exponential fast and that the underlying solution is also polynomial, exponential or 
power-exponential smooth in the Fourier domain. More precisely, consider the Gaussian 
white noise model 

dYe{t) = Af{t)dt + edW{t), teD, (1.1) 

where A is a known linear bounded operator acting on a Hilbert space T-L with values on 
L'^{D), D C M., W is a standard Wiener process on D, e > is a small parameter (the noise 
level) and f £ 7i is the unknown response function (that one needs to detect or estimate). 
In what follows, we assume that 71 C L'^{D). 

Although the Gaussian white noise model (II. Ih is continuous and real data are typi- 
cally discretely sampled, versions of it have been extensively studied in the nonparametric 
literature and are considered as idealized models that provide, subject to some limitations, 
approximations to many, sampled-data, nonparametric models (see, e.g., [1], ^0\, [21] )• It 
may also seem initially rather remote. One may, however, be helped by the observation that 
what it really means is the following: for any function g G L^{D), C M, the integral 
Jj^ g{t)Af{t) dt, can be observed with Gaussian error having zero mean and variance equal 
to J^g'^{t)dt. 

For the sake of simplicity, below we consider only the case where A is injective (meaning 
that A has a trivial nullspace). In most cases of interest, A is a compact operator and 
the model (jl.ip corresponds to an ill-posed inverse problem since the inversion of A is not 
bounded. Let A* be the adjoint of A and assume that A* A is a compact operator on T-L, 
which is equivalent to A being compact on T-L. Denote with N the set of natural numbers, 
i.e., N = {1,2, . . .}. Then, an application of the spectral theorem for self-adjoint compact 
operators on Hilbert spaces ensures the existence of a (complete) orthonormal basis system 
of eigenfunctions {v?fc}fcgN of A* A with corresponding positive eigenvalues {pk}keN (since A 
is injective, which is equivalent to A* A being positive). More precisely, we have the following 
representation of A* A 

A*Af = Y^PkU.VkWk = Y,bldk^k, (1.2) 

fceN keN 

where bk = ^/pk > 0, G N, 6i > 62 > • • • > 0, and {^felfeeN are the so-called Fourier 
coefficients of / with respect to {(/^fclfeg^.The expansion (jl.2p is called the singular value 
decomposition (SVD) of A with singular values with respect to {v^fcjfcgN and 9k = 

{f,(pk), fe E N (see, e.g., [21], Chapter VI, pp. 203-204). Note also that, by Parseval's 
equality, 9 = {9k}keN G where P = {9 : EfcgN^fc < °°}- 

Clearly, ||A99fc|| = bk, /c G N. Let now ipk (the normalized image of (pk) be determined 
by the relation ipk = {^fk)/{\\A(pk\\) = b'J^^Acpk, A; G N. Then, the basis system {tpk}km is 
orthonormal since, for k,l G N, one has 

\\tpkf = b^'^{A^k,Aipk) = bf{A*Ay^k,^k) = b^^lW^kf = 1, (^fc,^/) = 0, k^l, 

and, furthermore, A*ipk = b'^^A*Aipk = bkfk- Denote by yk = {dY^, iljk) = ipk{t)dYs{t) and 
^k = {dW, ipk) = ipkit) dW{t), A; G N, the Fourier coefficients of dY^ and dW, respectively, 
with respect to {ilJk}k<^N- We then have the following expansion 

Vk = {Af, ^k) + eik = {Af, b^^Aifk) + e^k = bkOk + e^k, A: G N, 
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where ^fc, A; G N, are independent and identically distributed (iid) standard Gaussian (i.e., 
A/^(0, 1)) random variables. 

Thus, the Gaussian white noise model (jl.ip generates an equivalent discrete observational 
model in the sequence space, called the Gaussian sequence model, 

yk = bk9k + eCk, k£N, (1.3) 

where e > is a small parameter, and {6'fc}fcgN are, respectively, the (positive) 

singular values of (the injective compact operator) A and the Fourier coefficients of /, with 

respect to {v^fclfceN, and ~ A/'(0, 1), /c e N. 

Therefore, the problem of detection or estimation of the unknown response function / 
based on the observation of a trajectory {1^ = l^(t)}, t G D, generating from the Gaussian 
white noise model p.ip . corresponds to the problem of detection or estimation of the unknown 
sequence 6 = {9k}keN based on observations y = {yk}k<^N generating from the Gaussian 
sequence model (|1.3p . Since the goal is to detect or estimate 9 = {9k}keN and not bO = 
{bk9k}k&N in the Gaussian sequence model (II. 3p . one has to remove b = {bk}k<=N, which 
is equivalent to inverting the operator A in the Gaussian white noise model p.ip . Hence, 
the effect of the ill-posedness of the inverse problem is clearly seen in the decay of b^ as 
A; — )• oo. As k ^ oo, bk9k usually gets weaker and is then more difficult to detect or estimate 

9 = {9k}k£N- 

Observe now that Gaussian sequence model (II. 3p can be rewritten in the (equivalent) 
form 

Xk = 9k + eakik, A: e N, (1.4) 

where Xk = Hk/bk and ak = b'j^^ > 0, /c € N. In this situation, the difficulty of ill-posedness, 
and hence any asymptotic results, is measured by the rates (type of growth) of 0"^ as /c — t- oo. 
For polynomial rates, i.e., ak x k^, /3 > 0, as /c — ?■ oo, the inverse problem is called mildly 
(or softly) ill-posed, for exponential rates, i.e., ak ^ exp(/3/c), /3 > 0, as A; — )• oo, is called 
severely ill-posed, and for the case where ak+i/ak — )• oo as A; — )• oo, is called extremely ill- 
posed. Note that an extremely ill-posed inverse problem includes power-exponential rates, 
i.e., ak X exp(/3A;'^), /3 > 0, 7 > 1, as A: — >• 00. (In what follows, x is the symbol of 
equivalence in order of growth, i.e., the relation c„ x d„ means that there exists constants 
< Ci < C2 < 00 and no large enough such that Ci < Cn/dn < C2 for n > ng. We say 
that Cn{K) X dn{hi) uniformly over k € /C, if the similar inequalities hold true for all k G /C 
with constants < Ci < C2 < 00 and no which do not depend on k. The relation c„ ~ dn 
means that for any 5 G (0, 1) there exists no large enough such that 1 — 5 < Cn/dn < l + (5 
for n > no. The uniform version of the relation c„(k) ~ dn{K), k E /C, is defined similarly.) 

The study of ill-posed inverse problems (in the presence of additive random noise) was 
initiated in 1960- ies (see [2], [26]) and has been in the focus of recent statistical literature, 
mostly in the context of estimation of the unknown response function / based on observations 
from the Gaussian white noise model (II. ip . Several methods of estimation were proposed 
such as Tikhonov-Phillips type regularization techniques, recursive estimation procedures in 
Hilbert spaces and projection (or Galerkin) methods. For a survey on these and other recent 
results, we refer to, e.g., [5], [6] and [12]. The SVD of A, described above, is a natural way 
of projection for ill-posed inverse problems, leading to the equivalence between the Gaussian 
white noise model (jl.ip and the Gaussian sequence models (jl.3p - (jl.4p . 

Note, however, that the Gaussian sequence models (ll.3p - (ll.4p are not confined to the above 
situation only and they appear in many other situations. For example, they also describe 
the estimation of a signal from direct observations with correlated data, see [19] . Moreover, 
the theoretical results presented in subsequent sections are actually derived for the Gaussian 
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sequence model (jl.3p (or, equivalently, (|1.4p ) and are, therefore, independent of the way one 
can explore to arrive at this model. (We point out here that an analogous representation 
for certain homogeneous operators based on the wavelet-vaguelette decomposition (WVD), 
that simultaneously quasi-diagonalize both the operator and the a-priori information of the 
unknown response function, exists, see 0. This representation will be discussed in Section [6] 
in order to justify minimax detection for mildly ill-posed problems with Besov classes (bodies) 
of functions B^^, a > 0, g G (0, 2), t G (0, oo).) 

An important element of the Gaussian sequence models (ll.3p - (ll.4p is the prior information 
about the sequence 6 = {Ok}k£N- Successful detection or estimation of the sequence 6 = 
{6k}keN is possible only if its elements 6k, k G 'N, tend to zero sufficiently fast as k tends to 
infinity, meaning that the underlying response function / in the Gaussian white noise model 
(II. Ij) is sufficiently smooth. A standard assumption on the smoothness of / is to suppose that 
the sequence 6 = {^^IfceN belongs to an /'^-ellipsoid (body), < g < oo, in of semi-axes 
L/ak, G N, i.e., 

G = G,(a,L) = {0G/2. J^Wkekl" <L'i}, (1.5) 

ken 

where a = {ak}ken, o^k > 0, — )• oo as /c — )• oo, and L > 0. (Note that the requirement 
Ofc > 0, Ofc — )• oo as A; — )• oo, ensures that Qq{a,L) is a compact subset of /^.) The sequence 
O' = {flfclfceN characterizes the "shape" of the ellipsoid while the parameter L characterizes 
its "size". This means that for large values of k, the elements 9^, k £ 'N, will decrease in k 
and, hence, will be small for large k. (Certainly, the set Qq{a, L) is a ball of the radius L in 

P with respect to the norm \6\a,q = {Ylkm I'^k^kl'^)^^'' ■) 

Over the last decade, the range q G (0, 2] has attracted considerable attention in the 
nonparametric estimation literature, with the case q G (0, 2) considered mostly in well-posed 
problems. This range contains the "standard" case q = 2 and the "sparse" case q G (0, 2). In 
what follows, we also restrict our attention to these cases, i.e., we consider minimax signal 
detection in ill-posed problems with /"^-ellipsoids for the range q G (0, 2]. 

The functional sets of the form (II. Sp that are often used in various ill-posed inverse 
problems are the Sobolev classes of functions (see [28]) and the classes of analytic functions 
(see |15j). The Sobolev classes of functions are of the form 

Wq{a,L) = {f = J2(^k^k: eeeq{a,L)}, 

fcGN 

where Qq{a, L) = 0q(a, L), a = {ak}keN, ai = 1 and, for = 2, 3, . . . and for some a > 0, 

f (A;-!)", if A; is odd, 
ak = { ,„ , . i-e., ak-^k . 

I k , it A: IS even. 

The class of analytic functions is of the form 

Aq{a,L) = {f = Y,<^kVk: 0GGg(a,L)}, 

fceN 

where 0q(a,L) = Qq{a,L), a = {ak}keN, cik = exp(aA;), A; G N, for some a > 0. We also 
consider the class of generalized analytic functions defined as 

gq{a,L) = {f = ^ekipk: eeQq{a,L)}, 
fceN 
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where Qq{a,L) = @g{a,L), a = {ak}keNi l™iiiffc->-oo Q^fc+i/o^fc G (l)C>o]. This class includes 
the cases where = exp(aA;'^), G N, for some a > and r > 1 (the case r = 1 corresponds 
to the class of analytic functions). The Sobolev class of functions has been associated, e.g., 
with the estimation of derivatives of smooth functions while the classes of analytic and gen- 
eralized analytic functions has been used in, e.g., the estimation of the initial or boundary 
conditions in partial differential equations (see, e.g., [5], [6], [7j). 

Despite the growing number of works for the estimation problem in ill-posed inverse 
problems under the Gaussian white noise model (jl.lh (see, e.g., [3], [5], [6], [7], [13], [Hj, [22], 
|23j). very little work exists for the corresponding detection problem, see. Section 4.3.3 of [17] 
and [TT] (although their results are obtained from models that are neither formulated nor 
immediately seen as particular ill-posed inverse problems). It is our aim to present a general 
framework for the minimax detection study of the aforementioned ill-posed inverse problems. 
In particular, both rate and sharp asymptotics for the error probabilities in the minimax 
setup are studied in detail and minimax tests are constructed. By construction, however, 
the derived tests are, often, non-adaptive. In such case, minimax rate-optimal adaptive tests 
of rather simple structure for the various ill-posed inverse problems under study are also 
constructed. (We pinpoint that non-asymptotic minimax rates of testing for some of the 
ill-posed inverse problems under consideration are recently studied in [20j.) 

Before proceeding to the theoretical results, we briefly mention some illustrative examples 
arising in various scientific fields that lead to the Gaussian sequence model (jl.3p (or the 
equivalent model (jl.4p ). The various models presented below are scattered throughout the 
literature, see, e.g., [5]. [6]. [7]. [13], [Ti] and [20]. 

• differentiation (/ G ^^([0, 1]), periodic on [0, 1], {ipk}keN being the complex trigonomet- 
ric system on [0, 1]). The goal is to detect or estimate the m-th derivative f{t) = g^'^\t) 
(for some m S N), based on the observation of a trajectory {1^ = l^(t)}, t G [0,1], 
obeying the Gaussian white noise model (jl.ip with D = [0, 1], = {/ : / G 
^^([0>l])Jo /(O*^* = 0}, ^ C i^^([0,l]) and Af{t) = Ag^'^^t) = g{t). This prob- 
lem corresponds to a mildly ill-posed inverse problem since 6^—7-0 (or, equivalently, 
cTfc oo) polynomially (with /? = m) fast as /c — t- oo. 

• the Dirichlet problem of the Laplacian on the unit circle (/ G L^([0, 27r]), periodic on 
[0,27r], {v'fcjfcgN being the trigonometric system on [0,27r]). The goal is to detect or 
estimate the boundary condition / based on the observation of a trajectory {Y^ = 
y^((/?)}, ip G [0, 2tt], obeying the Gaussian white noise model (jl.ll) with ip in place of t, 
D = [0, 27r],n = L2([0, 2tt]) and Af{t) = u{ro, ip), where u{r, ip), r G [0, 1], G [0, 27r], 
is the solution of the Dirichlet problem of the Laplacian on the unit circle in polar 
coordinates with boundary condition u{l,ip) = f{ip). This problem corresponds to a 
severely ill-posed inverse problem since 6^ — )• (or, equivalently, Uk oo) exponentially 
fast as /c — )• oo. 

• the heat conductivity equation (/ G L^([0, 1]), periodic on [0,1], {vfejfeeN being the 
complex trigonometric system on [0, 1]). The goal is to detect or estimate the initial 
condition / based on the observation of a trajectory {Y^ = Y^{x)}, x G [0, 1], obeying 
the Gaussian white noise model (jl.ip with x in place of t, D = [0, 1], Ti = L^([0, 1]) 
and Af{t) = u{T,x), where u{t,x), t > 0, x G [0,1], is the solution of the heat 
conductivity equation with periodic boundary conditions and initial condition u(0, x) = 
f{x). This problem corresponds to an extremely ill-posed inverse problem since bk ^ 
(or, equivalently, ak — )■ oo) power-exponentially fast (with 7 = 2) as /c — )■ oo. 
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• deconvolution (/ G ^^([0, 1]), periodic on [0, 1], {ipk}k£n being the complex trigonomet- 
ric system on [0, 1]). The goal is to detect or estimate the response function / based on 
the observation of a trajectory {1^ = y^(t)}, t G [0, 1], obeying the Gaussian white noise 
model ([Ll]) with D = [0,1], U = L^([0, 1]) and Af{t) = {g*f){t) = f{u)g{t - u)du, 
i.e., A is the convolution operator on L'^{[0, 1]), where the unknown kernel (or blurring 
function) g G ^^([0, 1]) is also periodic on [0, 1]. This problem corresponds to a mildly, 
severely or extremely ill-posed inverse problem, depending on the decay of = \i^k\ to 
zero as /c — t- oo, where I'k, k gN, are the Fourier coefficients of g. 

The above formulation and the various ill-posed inverse problems considered are based 
on the singular value decomposition of A, under the Gaussian white noise model (jl.ip . How- 
ever, it is well know that although offers a kind of diagonalization, SVD has its limitations 
rooted in the fact that the resulting eigenfunctions derive from the operator under study, 
not from the signal to be recovered. To this end, under the Gaussian white noise model 
(jl.ip . we also consider the signal detection problem for mildly ill-posed inverse problems 
with Besov classes (bodies) of functions, B^ -f., a > 0, q £ (0,oo), t G (0,oo). This problem 
arises through the WVD of a special class of homogeneous operators (such as integration or 
fractional integration), and simultaneously quasi-diagonalizes both the operator A and the 
a-priori regularity of the function / to be detected. Restricting again our attention to the 
"sparse" case q G (0,2), both rate and sharp asymptotics for the error probabilities in the 
minimax setup are studied. Minimax rate-optimal non-adaptive and adaptive tests are also 
constructed. 

The rest of the paper is organized as follows. The general statement of minimax signal 
detection in ill-posed inverse problems is given in Section [2l To help the readers, a short 
description of the main results and a comparison with similar results obtained in the cor- 
responding estimation problems are presented in Section [3l The general methods for the 
study of minimax signal detection in ill-posed inverse problems with /^-ellipsoids are given 
in Section 14.11 In Sections I4.2H4.71 we provide a complete treatment to the minimax sig- 
nal detection problem for mildly, severely and extremely ill-posed inverse problems with 
/^-ellipsoids, q £ (0,2], for Sobolev, analytic and generalized analytic classes of functions 
under the Gaussian sequence model (|1.3p . We study both rate and sharp asymptotics for 
the error probabilities in the minimax setup. By construction, the derived tests are, often, 
non-adaptive. In Section [5l for the ill-posed inverse problems under consideration, we also 
construct minimax rate-optimal adaptive tests of rather simple structure. We pointout that, 
sharp, rate and rate-adaptive optimality results for the case of mildly ill-posed inverse prob- 
lems with (i) /"^-ellipsoids, q G (0,2), for Sobolev classes of functions, and (ii) Besov classes 
of functions, B^^, a > 0, t £ (0, oo), q G (0,2), are of different nature, more complicated, 
and do not follow directly from the general framework considered above. However, as we 
reveal in Sections 14.71 and [H these results can be obtained from a hitherto unknown link 
with the sequence models considered in this paper and results obtained in other contexts 
and presented in Chapters 4, 6 and 7 of [17]. Since these results are scattered in the cited 
reference, and not not immediately seen as ill-posed inverse problems, for completeness and 
an immediate access, we formulate and present them in Sections 14.71 and [H The proofs are 
postponed until the Appendix. 
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2 Signal detection in the Gaussian sequence model: the min- 
imax framework 



Consider the Gaussian sequence model (11. 3p . In order to avoid having a trivial minimax 
hypothesis testing problem (i.e., trivial power), one usually needs to remove a neighbor- 
hood around the functional parameter under the null hypothesis and to add some additional 
constraints, that are typically expressed in the form of some regularity conditions, such as 
constraints on the derivatives, of the unknown functional parameter of interest (see, e.g., |17j . 
Sections 1.3-1.4). 

In view of the above observation, the main object of our study is the hypothesis testing 
problem 

Ho: 9 = 0, versus Hi: lofc^fc^ < 1, ^ei>r2, (2.1) 

fceN fceN 

where 9 = {^fcjfcgN ^ l'^, a = {ai:}keN, > 0, Ofc — )• oo as A; — )• oo, > 0, — )• 0, is a 
given family, and q E (0,2]. It means that the set under the alternative corresponds to an 
/'^-ellipsoid of semi-axes l/a^. A; G N, with an /^-ball of radius removed. (For simplicity in 
the calculations of the main results in subsequent sections, we focus attention on ellipsoids 
of the form ([13]) with "size" L = 1.) 

Consider now the sequence r] = {r]k}k£N with elements rjk = bk9k = 9k/<7k, k £ N. Recall 
that, in the ill-posed inverse problems under consideration, = l/6fc — )• oo or 6^ — )• 0, as 
A; — 7- oo. Hence, rj £ P, and the Gaussian sequence model (II. Sh is of the form 

yk = Vk + £Ck, ken. (2.2) 

The hypothesis testing problem (|2.ip can also be written in the following equivalent form 

Hq : T] = 0, versus Hi : rj £ @q{rs), (2.3) 
where the set under the alternative, i.e., 0g(re), is determined by the constraints 

G, = {r? G /2 : \akakm\' < 1}, e,(r,) = {r? € 6, : ^ ajr^l > r^}, (2.4) 

keN fcGN 

i.e., the set under the alternative corresponds to an /''-ellipsoid of semi-axes l/(afc(Tfc), k £N, 
with an /^-ellipsoid of semi-axes r^/uk, G N, removed. 

We are therefore interesting in the minimax efficiency of the hypothesis testing problem 
(|2.3p - ()2.4p for a given family of sets = &q{re) C It is characterized by asymptotics, as 
e — )• 0, of the minimax error probabilities in the problem at hand. Namely, for a (randomized) 
test ijj (i.e., a measurable function of the observation y = {yk}keN taking values in [0, 1]), the 
null hypothesis is rejected with probability 'ip{y) and is accepted with probability 1 — ilj{y). 
Let P^^ri be the probability measure for the Gaussian sequence model ()2.2p and denote by 
Eg^ri the expectation over this probability measure. Let ae{ip) = E^^Tp be its type I error 
probability, and let /^^(Be, V') = sup^g0^ ^£,»y(l ~ V') be its maximal type II error probability. 
We consider two criteria of asymptotic optimality: 

(1) The first one corresponds to the classical Neyman-Pearson criterion. For a G (0,1), 
we set 

Pe{@e,a)= inf ^e{@e,i')- 

We call a family of tests V'e.a asymptotically minimax if 

ae{lpe,a) <a + o{l), ^,(6^, ^e,a) = /3e(e„ a) + o(l). 
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where o(l) is a family tending to zero; here, and in what follows, unless otherwise stated, all 
limits are taken as e — )• 0. 

(2) The second one corresponds to the total error probabilities. Let 'JsiQejip) be the sum 
of the type I and the maximal type II error probabilities, and let jsi'Sie) be the minimax total 
error probability, i.e., 

7.(e,)=inf7e(e„V'), 

where the infimum is taken over all possible tests. We call a family of tests '0e asymptotically 
minimax if 

7.(e„^e) = 7.(e.) + o(i). 

It is known that (see, e.g., [17J, Chapter 2) that 

/3e(e„a) G [0,1-a], 7^(6^)= inf (a + /3,(e„ a)) e [0, 1]. (2.5) 

ae{o,i) 

We consider the problems of rate and sharp asymptotics for the error probabilities in 
the minimax setup. The rate optimality problem corresponds to the study of the conditions 
for which 7e(0£) —5- 1 and 7e(©£) — >• and, under the conditions of the last relation, to 
the construction of asymptotically minimax consistent families of tests ipe, i.e., such that 

For the set of the form (|2.4p . we use the notation 7e(0g(re)) = 'yeii^e) and /3e(0q(re), a) = 
/3e (rg , a) , and we are interesting in the minimal decreasing rates for the sequence such that 
7e(r(;) — )• 0. Namely, we say that the positive sequence r* — )■ is a separation rate, if 

lei'/'e) — ^ 1) and I3e{r^,a) — )• 1 — a for any a G (0, 1), as r^/r* — )• 0, (2.6) 

and 

7e(r£) — )• 0, and /3e(r£, q) — )■ for any a G (0, 1), as r^/r* — )• cxd. (2.7) 

In other words, it means that, for small e, one can detect all sequences rj £ Qq{re) if the ratio 
r^/r* is large, whereas if this ratio is small then it is impossible to distinguish between the 
null and the alternative hypothesis, with small minimax total error probability. Hence, the 
rate optimality problem corresponds to finding the separation rates r* and to constructing 
asymptotically minimax consistent families of tests. 

On the other hand, the sharp optimality problem corresponds to the study of the asymp- 
totics of the quantities /3e(0£,a), 7e(0£) (up to vanishing terms) and to the construction of 
asymptotically minimax families of tests ip^^a and ipe, respectively. We shall see (see Section 
14. ip that often the sharp asymptotics are of Gaussian type, i.e., 

/3e(r„a) = $(F(")-n,) + o(l), je{re) = 2H-u,/2) + o{l), (2.8) 

where $ is the standard Gaussian distribution function, H^"'^ is its (1 — a)-quantile, i.e., 
$(^(")) = 1 _ Q,. The quantity = U£{r^) is the value of the specific extreme problem ()4.ip 
on the sequence space l'^, and the extreme sequence of this problem determines the structure 
of the asymptotically minimax families of tests Vc.a and Moreover, we shall see that if 
Ue{re) oo, then je{re) 0, /3e(re,Q) 0, and if Ue{re) 0, then 7e(re) 1, /3eirs,a) -)• 
1 — a for any a £ (0, 1), i.e., the family Ue{re) characterizes distinguishability in the testing 
problem. The separation rates r* are usually determined by the relation Ue{r*) x 1 (see, 
e.g., [16], [IZj). Hence, sharp and rate optimality problems correspond to the study of the 
extreme problem (14. ip and of the asymptotics of the family ^^(rg). 

Hereafter, the relations ~ and x i?^ as e — t- are defined similarly to those 
mentioned in Section [TJ Let also ^{a} be the indicator function of a set A and let (a)+ = 
max{0, a}. 
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3 Minimax signal detection in ill-posed inverse problems: a 
short description of the main results 

Sharp and rate optimality results for the specific ih-posed inverse problems under consid- 
eration are discussed in detail in Section HI In this section, we give a short description of 
these results for mildly and severely ill-posed inverse problems with Z'^-ellipsoids, q G (0,2], 
for Sobolev and analytic classes of functions. 

First, consider the "standard" case q = 2. The asymptotics of the quality of testing Ue{re) 
as — )• is presented in the following table: 



Detection Problem 


Sobolev classes 


analytic classes 


mildly ill-posed 




C2e-2r2(logr7i)-2/3-i/2 


severely ill-posed 




^-2^2(Q+/3)/a 



Here, ci = ci(a, /3) > 0, C2 = C2(a, /?) > are some constants. We have the sharp asymptotics 
of the form ()2.8p for mildly ill-posed inverse problems with Sobolev and analytic classes of 
functions, with either ~ Ak'^ or ~ Aexp{ak), and ~ Bk^, /c G N. Furthermore, the 
separation rates r * as e — t- are presented in the following table: 



Detection Problem 


Sobolev classes 


analytic classes 


mildly ill-posed 


^4a/(4a+4/3+l) 


e(loge-i)'^+V4 


severely ill-posed 


((loge-i)//3)-" 





Note that the separation rates are sharp in severely ill-posed inverse problems with 
Sobolev class of functions, with ~ A;" and bk x exp{—/3k), k gN. It means that 

'Jeirs) — >• as lim r^/r* > 1, 7e(?'e) — 1 as lim r^/r* < 1. 

(Similar non-asymptotic minimax rates are recently given in |20j.) We do not present the 
results for extremely ill-posed problems with the class of generalized analytic functions in 
this short description because the asymptotics are more complicated in this case. Roughly 
speaking, these asymptotics are determined by a piecewise linear function it^*" = n^*"(r£) 
and, principally, seem to be of a new type, see Section 14.61 and remarks therein for details. 
(Moreover, in subsequent sections, we consider this case only for q = 2.) 

Consider now the "sparse" case q E (0,2). Then, the results noted above still hold true 
for severely ill-posed problems with Sobolev and analytic classes of functions. For mildly 
ill-posed problems with the class of analytic functions, we also get the same separation rates 
r*. However, the situation for mildly ill-posed problems with Sobolev classes of functions is 
more delicate. More precisely, let a > 0, /3 > and set X = {a + /3) /2 — 13 /q. If A > 0, then 
the sharp asymptotics are of the Gaussian type (12. Sp with 

U, = c3e-(2°+l/g-l/2)/(a+/3(l-2/<7))^{2(a+/3)+l/g)/{a+/3(l-2/g)) 

for some constant C3 = 03(0, /3, q) > 0, while the separation rates r* are of the form 

^* ^ ^(2a+l/<?-l/2))/(2(a+,3)+l/g) _ 

On the other hand, if A < 0, then the sharp asymptotics are of the following degenerate type 
/3,(q) = (1 - aM-De) + 0(1), 7e = H-D,) + o(l). 
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where 

De = nJ^Te/e - \/21og(n,), n, = r^V"^ 
while the separation rates r* are of the form 

r* = Ae"/("+^)(log(e-^))"/2{"+/3), a = (2/(a + /3))°/2{"+/3). 

We now compare the above mentioned minimax rates of testing with the corresponding 
minimax rates of estimation. The minimax estimation problem for the Gaussian white noise 
model (II. Ij) (or, equivalently, for the Gaussian sequence model (II. 3p ) was studied very inten- 
sively in statistical ill-posed inverse problems, see, e.g., [5] (and references there in), [B], [7], 
|13] and |14] . The main object of the study is the minimax quadratic risk, defined by 

E2(^)=infsupi^,j||/-/f, 
/ /eJ- 

where the infimum is taken over all possible estimators / of / based on observations from 
the Gaussian white noise model (jl.ip . 

For the main types of the ill-posed inverse problems and classes of functions under con- 
sideration with /^-ellipsoids, q = 2, the rates of Re{^) as e — )• are presented in the following 
table (see, e.g., [5]): 



Estimation Problem 


Sobolev classes 


analytic classes 


mildly ill-posed 


g2a/(2a+2/3+l) 


e(log £-1)^+1/2 


severely ill-posed 


(loge-i)-° 





For mildly ill-posed problems with /'^-ellipsoids, q G (0,2), for Sobolev classes of functions, 
one has for A > 0, 

Re X e("~l/2+l/g)/(a+/3+l/g) ^ 

while, for A < 0, the rates of Re in the estimation problem coincide with the separation rates 
r* in the corresponding detection problem (see, e.g., llTJ, Section 2.8, and references therein.) 

Observe that the minimax rates of testing are faster than the corresponding minimax rates 
of estimation (as it is common in nonparametric inference, see, e.g., [T7j, Sections 2.10 and 
3.5.1), except for the cases of mildly ill-posed problems with /''-ellipsoids for Sobolev classes 
of functions with q G (0, 2) and A > and the cases of severely ill-posed inverse problems 
with /^-ellipsoids for Sobolev and analytic classes of functions. (To the best of our knowledge, 
we are not aware of any minimax estimation results with the case of severely ill-posed inverse 
problems with /''-ellipsoids, q G (0,2), for Sobolev and analytic classes of functions.) 

Returning to the signal detection problem, note that, except for the case of mildly ill-posed 
inverse problems with /''-ellipsoids, q G (0, 2], for analytic classes of functions and for the case 
of mildly ill-posed problems with /''-ellipsoids, q G (0,2) (and A < 0), for Sobolev classes 
of functions, the aforementioned separation rates r* hold true for the known parameters 
{a, f3,q) associated with the classes of functions and the ill-posed inverse problems under 
consideration. The rate-optimal tests depend on the parameters {a, /3, q) for these cases as 
well. In practice, the parameters a and q associated with the considered functional classes 
are typically unknown and, very often, the statistician is not confident about the value of the 
parameter /3 that characterizes the spectrum of the operator A* A. For unknown parameters 
(a, /3, g) G S C x (0, 2] := (0, oo) x (0, oo) x (0, 2], we have the so-called adaptive problems: 
in order to distinguish between the null hypothesis and the 'combined' alternative, which 
corresponds to a wide enough compact set S C x (0, 2], it does not suffice to just require 
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Ue = Ui;{rg{a, I3,q),a, (3,q) — oo for all {a,(3,q) G S; instead, one needs that it should tend 
to oo faster than some family n"*^ — )• oo, which is a 'payment' for adaptation, see |25j . 

Adaptive rate optimality results for the specific ill-posed inverse problems under consid- 
eration are discussed in detail in Section [3 Below, we give a short description of these results 
for mildly and severely ill-posed inverse problems with /''-ellipsoids, q £ (0, 2], for the Sobolev 
and analytic classes of functions. 

We shall see that n^"^ x 1 for mildly ill-posed inverse problems with /''-ellipsoids, q G (0, 2] 
for the class of analytic functions and for the Sobolev class with A < 0, while for mildly 
ill-posed inverse problems with /''-ellipsoids for the Sobolev class of functions with A > one 

has 

uf = Vlogloge-i. 

On the other hand, for severely ill-posed inverse problems with /''-ellipsoids for the Sobolev 
and analytic classes of functions (as well as for extremely ill-posed inverse problems with 
/^-ellipsoids for the class of generalized analytic functions), we shall see that 

^ad ^ log log e"^. 

These yield the adaptive separation rates r^'^ presented in the following table (here q = 2 for 
mildly ill-posed problems with ellipsoids for the Sobolev classes): 



Detection Problem 


Sobolev classes 


analytic classes 


mildly ill-posed 




e(log £-1)^+1/4 


severely ill-posed 


((loge-i)//?)-" 





where 

ii = e\/logloge-^ £2 = eylogloge^. 

On the other hand, for the "sparse" case q G (0, 2) and A > 0, for mildly ill-posed problems 
with /''-ellipsoids for Sobolev classes of functions, the adaptive separation rates r^'^ are of the 
form 

nd _ ~{2a+l/<i,-l/2))/(2(a+/3)+l/g) 

We have the same adaptive rates for mildly ill-posed problems with Besov classes for q G 
(0,2), A>0. 

We conclude this short description by saying that, as we shall show in Section [Sj the rate- 
optimal adaptive tests are of rather simple structure for all problems under consideration 
(except for mildly ill-posed problems with /''-ellipsoids, q G (0,2), for Sobolev classes of 
functions, and Besov classes): they are based on combinations of tests based on a grid of 
centered and normalized statistics of x^'type and on simple threshloding. For mildly ill- 
posed problems with /''-ellipsoids, q £ (0, 2), for Sobolev classes of functions, the rate-optimal 
adaptive tests are more complicated (see Remark 16.41 in Section [6]) . 

4 Minimax signal detection in ill-posed inverse problems: rate 
and sharp asymptotics 

4.1 A general result for l'^ -ellipsoids: the "standard" case q = 2 

Consider the Gaussian sequence model (12.2p . We are interested in the hypothesis testing 
problem ()2.3p with the set under the alternative = 02('^e) given by ()2.4p with q = 2. 
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Consider now the extreme problem 



ul = uUr,)='jniX^l (4.1) 



feGN 



Suppose that 0(r£) ^ and Ue > 0, and let there exist an extreme sequence {fik}km in the 
extreme problem ()4.ip . (Observe the uniqueness of a nonnegative extreme sequence {fjk}, 
G N, because, by passing to the sequence {zk}keN with elements Zk = fj'^, k £ N, we obtain 
the minimization problem of a strictly convex function under linear constraints.) Denote 

~2 

Wk = — = ^ , A: g N, wo = sup7i;fc, (4.2) 
^ Z^feeN 'Ik 

and consider the following families of test statistics and tests 

te = Y,^k {{Vk/ef - 1) , llJe,H = ^{t,>H}- (4-3) 

k&i 

(Note that the values of fjk-, Wk, k G'N, and wq depend on e, i.e., fjk = fjk^e-, Wk = Wk^e-, A; G N, 
and Wo = wo,e-) 

The key tool for the study of the above mentioned hypothesis testing problem is the 
following general theorem. 

Theorem 4.1 Consider the Gaussian sequence model h2. 2\) and the hypothesis testing prob- 
lem ^2.3\) with the set under the alternative given by 12. 4\) with q = 2. Let be determined by 
the extreme problem j] ), let the coefficients Wk, k £N, and wq be as in Ili4.2\ ), and consider 
the family tests ipe,H given by |^.3| ). Then 

(1) (a) If Ue —5- 0, then (3s{rs,a) — )• 1 — a for any a G (0,1) and ^eije) — ^ 1; ^-c, 
minimax testing is impossible. If = 0(1), then lim inf (r^ , a) > for any a £ (0, 1) and 
liminf7£(r£) > 0, i.e., minimax consistent testing is impossible. 

(b) If Us X 1 and wq = o(l), then the family of tests '4'e,H of the form with H = H^"^ 
and H = ng/2 are asymptotically minimax, i.e., 

"e(V'e,H('^)) ^ a + o(l), 
/?e(0(r£),V'e,iy(-)) = l^e{re,a) + o{l), 
le{'d{re),i^e,u,/2) = le{re) + o{l), 

and the sharp asymptotics \2. 8\) hold true, i.e., 

f}e{re,a) = $(i/(°)-ne) + o(l), 
7,(r,) = 2$(-n,/2)+o(l). 



(2) If Us — )• oo, then the family of tests ipe,H of the form ^.3\ ) with H = are asymptot- 
ically minimax consistent for any c G (0, 1) and a family ~ cu^, i.e., 7e(0(r£), ^^^7^^) — )• 0. 

The proof is given in the Appendix, Section 17.11 

Theorem 14.11 shows that the asymptotics of the quality of testing is determined by the 
asymptotics of values u^ of the the extreme problem (j4.ip . In order to make use of it, 
one needs to study the extreme problem (14. ip . This problem is studied by using Lagrange 
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multipliers. Then, the extreme sequence in the above mentioned extreme problem is of the 
form 

f,l = zial{l-AalU, ken, (4.4) 



where the quantities zq = zo,£ and A = As are determined by the equations 



2^2 _ ^2 



(4.5) 



i SfceN ^k^k^k — 1- 

The equations ()4.5p are immediately rewritten in the form 

I '■' = ^0^1' (4.6) 
1 l = ziA~^J2, ^ ^ 

and, hence, the extreme problem (|4.ip takes the form 

uj = e-^zpon. (4.7) 

where 



Jl = ^^7^(1-^4) + , 

km 

J2 = A^alalil- Aal)+, 
fceN 

Jo = J,-J2 = Y,4{'^-Aal)l. 

km 

It is also convenient to rewrite (14.611 and (14.711 in the form 



Note that, the first equation in (j4.8p is used to calculate A which determines the efficient 
dimension m in the specific ill-posed inverse problems considered below: if is an increasing 
sequence (it is assumed further), the efficient dimension is a quantity m = G [l,oo) such 
that Aa\^^ < 1 < Aaf^^^^. 

Remark 4.1 Since, in the ill-posed problems under consideration, fj^ — )• 00 as A: — )• 00, it is 
immediate that J2keN^k ~ Under this condition, and the fact that — )• cxd as A; — 00, 
one can see that, for small enough, the equations in (j4.6p have a unique solution (see 
Proposition 17.21 in the Appendix, Section [7?8|l . 

Remark 4.2 Let Us = Us{rs) be the value of the extreme problem (14. ip with sequences 
a = {ofclfceN and a = {ak}keN associated with the set under the alternative 0^ = 0(re) 
given by (12. 4p . and let tt^ = Usire) be the corresponding value of the extreme problem similar 
to ()4.ip with sequences a = Ca = {Cak}km and a = Da = {-Do-fcjfcGN in (j2.4p . for some 
positive constants C and D. Then, it is easily seen that the relation ■Ue(r£) = {CD)"'^Us{Crs) 
holds true. 
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4.2 Application to mildly ill-posed inverse problems with the Sobolev 
class of functions 

Consider first the "standard" case q = 2. Then, the fohowing statement is true. 



Theorem 4.2 Consider the Gaussian sequence model h2. ^|) and the hypothesis testing prob- 
lem h2.3\) with the set under the alternative given by {2.4\) with q = 2. Let = and 
ak = k^, keN, a>0, /3 > 0. Then 

(a) The sharp asymptotics \2. ^) hold with the value of the extreme problem ( [^. 
determined by (f7. 7| j. 

(b) The asymptotically minimax family of tests ipe,H determined by the family of test 
statistics t^ given by ll[4-3\ ) with coefficients Wk, G N and wq as in ^-2^ , and with extreme 
sequence {fjk}k^n given by {7.0() with m determined by |7. 

(c) The separation rates are of the form 

The proof is given in the Appendix, Section 17.21 

Remark 4.3 It fohows from the evaluations of the functions Jq, Ji and J2 that their asymp- 
totics are determined by the tails of the sequences a^ = k°' and ak = kf^ , k £ N, a > 0, (3 > 0. 
For this reason, in view of Remark 14. 2^ we get the sharp asymptotics (17. 8p for the sequences 
o-k ~ ^" and 0" ~ A;'', A; G N, a > 0, /3 > 0, and similar rate asymptotics for the sequences 
Ofc X /c", o" X A;'^, A; G N, a > 0, (3 > 0. In both cases, the separation rates are still of the 
form K9\i. 



A family of asymptotically minimax consistent tests of simple structure 

If — )■ 00, then one can construct a family of asymptotically minimax consistent tests 
of simpler structure than (14. 3p . Indeed, observe that, by (I7.7p . one has 



.2 



r^a^ ~ c?, ci = ci(a,/3) > 1, x — , m = [m] G N (4.10) 



where [m] is the integral part of m. Hence, for an integer-valued family rh = rh^ — )• c«, one 
has 

a^+ir, > 5 + 0(1), B>1, X " , . (4.11) 
For each m G N, consider the following families of test statistics and tests 

^ m 

Then, the following statement is true. 

Theorem 4.3 Consider the Gaussian sequence model (2. 2\) and the hypothesis testing prob- 
lem ^2.cl\) with the set under the alternative given by \2.4^ with q = 2. Let = k" and 
Cfc = k^ J A; G N, a > 0, /3 > 0. Let the value of the extreme problem j[ ) be deter- 
mined by J 7. Tj ), and assume that Ug — )■ oo. Then, the family of tests ipe^H; given by J^.ii^ ) 
with m = m satisfying ^-11 ) and H = Hf, ^ oo, is asymptotically minimax consistent, i.e., 
otei'^e^He) ~^ '^'^^ there exists c > such that /3e(V'£,He) ©e) — )• as iJ^ < (c + o(l))ti£. 

The proof is given in the Appendix, Section 17.31 

Unlike the "standard" case q = 2, the "sparse" case q G (0, 2) is not directly linked will 
Theorem 14 . 1 1 and will be considered separately in Section [4.71 
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4.3 Application to severely ill-posed inverse problems with the class of 
analytic functions 

The following statement is true. 

Theorem 4.4 Consider the Gaussian sequence model h2. 2\) and the hypothesis testing prob- 
lem 112. 3\) with the set under the alternative given by ^2.4^ with q S (0,2]. Let = exp(aA;) 
and (Tfc = exp(/3A;), A; G N, a > 0, /3 > 0. Then 

(a) The asymptotically minimax consistent family of tests ipe,H (^f^ determined by the 
family of test statistics t^ given by ^-S^ with coefficients w^, /c G N, as in \4-'^ > o,nd with 
extreme sequence {fjk}k&i given by i7.14^ with m determined by i7.15\ ). 

(b ) The separation rates are of the form 

The proof is given in the Appendix, Section 17.41 

Remark 4.4 We do not consider sharp asymptotics in this case, since the assumption wq = 
o(l) does not hold for /? > in the "standard" case q = 2. Indeed, 

maxi<fc<m7/| z^exp(2/3m) 
Wo = — , ^ — 777^ — r >i i 7^ U. 



Remark 4.5 Similar to Remark 14.31 the asymptotics (j7.16p hold true for the sequences 
Qk X exp(aA;) and ak x exp(/3/c), k £ N, a > 0, /3 > 0. In this case, the separation rates are 
still of the form ()4.13p . Remark 14.41 still applies to these cases too. 



4.4 Application to severely ill-posed inverse problems with the Sobolev 
class of functions 

The following statement is true. 

Theorem 4.5 Consider the Gaussian sequence model ^2. ^|) and the hypothesis testing prob- 
lem i2.3\) with the set under the alternative given by {2.4^ . Let a/. = k" and = exp((3k), 
/c G N, a > 0, /? > 0. Then 

(a) The asymptotically minimax consistent family of tests ipe,H fl'^e determined by the 
family of test statistics given by 14.3^ with coefficients Wk, k £ 'N, as in l4-2() , and with 
extreme sequence {rik}k&i given by ( fZ j7| j with m determined by \7.18^ . 

(b ) The separation rates are of the form 

r* = ((log(e-i))//3)-". (4.14) 
The proof is given in the Appendix, Section 17.51 

Remark 4.6 It is worth mentioned that a stronger result is possible in this case. In view of 
(j7.18p . the relation (|4.14p determines sharp separation rates r* in the following sense, 
(a) if liminf {rg^/r*) > 1, then — >• 00, i.e., ^ei^e) — ^ 0. 

(6) If limsup (r^/r*) < 1, then — t- 0, i.e., 7e(?'e) — 1, and the minimax testing is 
impossible. 

Moreover the relation 

^ ((log(e-i) - aloglog(e-i)) //3) + 0(1), 
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determines the sharper separation rates r* in the fohowing sense. 

(c) If hminf ^r^ — (r*)""^/"^ = — oo, then — t- oo, i.e., Je{fe) ~^ 0. 

(d) If limsup (vs — ) = +00, then — t- 0, i.e., "feire) — >• 1 and the testing is 



asymptotically impossible. 

Remark 4.7 We do not consider sharp asymptotics in this case, since the assumption wq 
0(1) does not hold for /3 > in the "standard" case q = 2. Indeed, 



max ijl > BiZq exp{2(3m) /m, Bi > 0; 2 fjt x e^n^ x Zq exp{2(3m)/m, 

l<k<m \ ^ — ' 

- - y l<k<m 

and, therefore, 

_ max,<,<^^^g ^o^g"^exp(2/?mK.. ^ ^ 0_ 

V^E^;^ Zo-exp(2/3m) 

Remark 4.8 Similar to Remark 14.31 the asymptotics (j7.19p and the sharp separation rates 
()4.14p mentioned in Remark 14.61 hold true for the sequences ak x exp(/3/c), k £ N, (3 > 0. 
The dependence on the sequence {afcjfcgN is, however, more delicate. One can actually show 
that the sharp separation rates ()4.14p mentioned in Remark 14.61 are still of the same form for 
ak ^ k"' , k £ N, a > 0. Remark 14.71 still applies to these cases too. 



4.5 Application to mildly ill-posed inverse problems with the class of 
analytic functions 

Here, we consider the "standard" case q = 2. (The "sparse" case q G (0, 2) will be discussed 
in Remark 14.111 ) The following statement is true. 

Theorem 4.6 Consider the Gaussian sequence model ^2. 2\) and the hypothesis testing prob- 
lem i2. 3\) with the set under the alternative given by \2.4^ with q = 2. Let a^ = exp(aA;) and 
ak = k(^, k en, a>0, /? > 0. Then 

(a) The sharp asymptotics i2. 8]) hold with the the value of the extreme problem J^. j[ ) 
determined by ^7.25\ ). 

(b) The asymptotically minimax family of tests are determined by the test statistics t^ 
given by ^.3\ ) with coefficients Wk, k € N and wq as in ^4-^ , and with extreme sequence 
{fjk}keN given by \7.20^ with m determined by ^7.26\ ). 

(c) The separation rates are of the form 

rl=e{\oge-y+^/^. (4.15) 
The proof is given in the Appendix, Section 17.61 

Remark 4.9 It is also easy to see that, uniformly over (a,/3) G S, for any compact set 
S C M^, the efficient dimension m = ms{a,l3) satisfies 

m,(a,/3) ^ ^^°g(^"') ~ X log(e-i) as log(n,) = o(log(e-i)). (4.16) 

2a 

Remark 4.10 Similar to Remark 14.31 the asymptotics (|7.26p hold true for the sequences 
Ofc ~ exp(afc) and cifc ~ /c^. A: G N, a > 0, /3 > 0. Similar rate asymptotics hold true for the 
sequences Ok x exp(aA;) and cjfc x A;^, /c G N, a > 0, /3 > 0. In both cases, the separation 
rates are still of the form ()4.15p . 
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Remark 4.11 The rate asymptotics of Theorem 14.61 hold true uniformly in g G [5, 2], for any 
6 £ (0, 2). Indeed, in view of the embedding 

C G2, @g{re) C G2(r,), (4.17) 

for the sets defined by (j2.4p . it suffices to establish the lower bounds. Let Gg (L) be the set 
that is determined by the constraints 

G^(L) = {?? G /2 . ^ I exp(aA:)A:^%|'? < L*}. 

fcGN 

(Note that the set Gg (1) just corresponds to the set under the alternative considered above.) 
For any ai = a + 6, 6 > 0, the fohowing embedding is true: 

G^i(cL) C G^(L), c = c(g,5) = (exp(2g5/(2-g))-l)(2-'?)/29, c(g, 5) ^ exp(5) as g / 2. 

(4.18) 

Using Holder's inequahty, the embedding (]4.18p follows easily on noting that 
I exp(afc)fc^?7fc|'^ = I exp(aifc)fc^?7fc|'^ exp(— g(5) 

fcGN fcGN 

< ^(exp(afc)A:^r/fc)2 exp(-2M/(2 - «)) 

\ fceN / 

Since the separation rates from Theorem 14.61 do not depends on a and c, in view of Remark 
14. 10^ the rate asymptotics of Theorem 14.61 hold true uniformly in g G [5, 2], for any 6 £ (0, 2). 

A family of asymptotically minimax adaptive consistent tests of simple structure 

A family of asymptotically minimax consistent tests of simple structure, that is also 
adaptive, in the sense that it does not depend on the unknown parameters a, j3 and q G (0, 2], 
is constructed as follows. Let a compact set S = {(a, /3)} C be given. Denote by Q£,o,/3(r) 
the set under the alternative given by ()2.4p with r = re(a,/3) and q = 2. Let U£^a,i3{r) be the 
value of the extreme problem (|4.ip for the set G^ = Qe,Q,/3(r'). Observe that, for = exp(a/c) 
and ak = k^ , k € N, a > 0, l3 > 0, and for e small enough, in view of (I4.16p . 

clog(e"i) <m,(a,/3) <Clog(e-i), 

as 

sup I log(ne,a,/3(?-e(a,/3)))| = o(log(e"^)), 
{",/3)es 

where the constant c and C satisfy 

< max < C, < c < min . 

(a,/3)GS (a,/3)GS 



Set 



u,{J:)= inf Ue,aAre{a^f^))- (4-19) 

{o,/3)GS 



Then, the following statement is true. 
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Theorem 4.7 Let = exp{ak) and = , A; G N, q > 0, /3 > 0. Consider the Gaussian 
sequence model \2.S\) and the hypothesis testing problem 12. 3\) where Oe,a,/3(T') denotes the set 
under the alternative given by 1^2. 4\ l with r = r£(a, /3) and q = 2, and let ri,{a,f3) be taken 
in such way that UeiJ^) in Ii4.19\ ) satisfies tte(S) — t- oo. Then, the family of tests ilJe,H given 
by l^.i^ ) with m = Clog(e~"'^) + 0(1) G N, m > Clog(e~^) is adaptive and asymptotically 
minimax consistent, i.e., a£{ipe,H) —^0 as H ^ oo and one can take -fT = -fTg — )• oo such that 
/3e(V'e,-H'5 0£,o,/3(^e(Q^) /3))) ~^ 0; uniformly over (a,/3) € S. In view of the embedding {4.11^ , 
these hold true uniformly in q £ (0,2]. 



The proof is given in the Appendix, Section 17.71 



Remark 4.12 As stated in Theorem 14.71 the family of tests ips,H given by ()4.12p with 
rh = Clog(e~^) + 0(1) G N is adaptive with respect to the unknown parameters a, (3 and 
q G (0,2]. Furthermore, there is no price to pay for this adaptation, meaning that both non- 
adaptive and adaptive procedures for the considered ih-posed problem share, asymptotically, 
the same separation rates. However, this is usually an exception to the rule and in most cases 
there is a price to pay for the adaptation which is usually appear in the form of an extra 
log-log factor in the separation rates. The study of adaptivity in the remaining considered 
ill-posed problems and the construction of appropriate rate optimal families of tests is the 
theme of Section [3 



4.6 Application to extremely ill-posed inverse problems with the class of 
generalized analytic functions 

We consider the case q = 2 only. Assume that {afcjfcgN and are increasing sequences 

such that 

lim (Tfe+i/fTfc — )• oo, liminf Ofc+i/ofc = c, c G (l,oo]. (4.20) 

A;— ^-oo fc— >oo 

In order to describe the asymptotics of the value Us = Us{r) of the extreme problem (14. ip . 
we introduce the following functions. 

Let m G N, m > 2, Aj^ = [l/om, l/flm-i], and for r < 1/ai take m = m{r) > 2 such that 
r G A^. Consider now the piecewise quadratic (in r^) function defined by 



Ki^)r = ^ ( + ' ) ' (4-21) 



and the piecewise linear (in r^) function defined by 
Then, the following statement is true. 



Theorem 4.8 Let Us = Ue{r) be the value of the extreme problem j^. j[ ). Let {u*{r))'^ be the 
piecewise quadratic (in r"^) function defined by (J^ip and let ^^"(r) be the piecewise linear (in 
r^j function defined by where {ofclfceN and {ak}keN be increasing sequences satisfying 

[tlW - Then 

(a) (sharp asymptotics of u^) The families Uf,{r) and u*{r) are related by 

Ue{re) ~ ul{re) as r^ 0. (4.23) 
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(b) (rate asymptotics of Uf,) The families u^{r) andu^^{r) are related by 

nf (re)(l/2 + o(l)) <n,(r,) <nf (r,)(l/^/2 + o(l)) as r, ^ 0. (4.24) 



(c) (distinguishability conditions) Consider the Gaussian sequence model \2. 2) and the 
hypothesis testing problem 12. 3\) with the set under the alternative given by (2^. Then 



leife) —^0 if and only if u^'"'{r^) — )• oo 

and 



7e(r£) ^1 if and only if <"(r£) 0. 

The proof is given in the Appendix, Section I7.8[ 

Remark 4.13 It is easy to see that the relation li4-24\ ) is true uniformly over all sequences 
{dfcjfcGN and {ak}kefi such that au+i/cTk > Bk, Bk oc, and Ok+i/ak > c, as k > ko, 
ko > 1. 

Remark 4.14 We do not consider sharp asymptotics in this case, since the assumption 
wq = o(l) does not hold under assumption (j4.20p . Indeed, using (j7.3ip - (j7.32p . it can be 
easily seen that 



Vk ~ Vm-1 + V: 

and, therefore. 



4 

fc=l 



wq = — ~ ~ ~ — 1^^^=^^^^ > 1/2 -ft 0. 



X 1 determines the separation rates r* that are rather 
sharp in the follows sense. Let r* = for some m G N, m — >• oo, and let = (l + 6)(r*)^ G 
(a~^,a~^-^), 6 > 0. Then, one has 

(r) = uf(r*)(l + fe^6), 

where, as m — )• oo, 

2 /' / \ 2 2 2 
^ ^ m—XOirn—X I rriO'm) ^ ^ ^ 

l-(am-i/am)2 - (a„_i/am)2) ^ cr^_i 

Therefore, in order to obtain u^^"'[r^) — t- oo, it suffices to take = r*(l + 5) for any 5 > 0. 
On the other hand, let = (1 — G (^^m+i' ^m^)' ^ ^ (^i Then, similarly, one has 

nf (r)=nf (r,*)(l-/„6). 



where, as m — )• oo, 



•1. 



1 — (am/flm+l)^ 1 — (Om/am+l)^ 

If 

Q-m+i/fl-m ^ OO as TTi )" OO, then, in order to obtain u^*"(rj) y 0, one needs to take r^ 
such that r^/r* — )• 0, and if am+i/om — ^ c, 1 < c < oo, then, for ^^"(rg) — )• 0, one needs to 
take < 'r*/c. Thus, the conditions for distinguishability and non-distinguishability could 
be non-symmetric in these problems. 
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Remark 4.16 Let us consider the example 

afc = exp(a/c^), a > 0, r > 1, o"fc = exp{f3k'^), /3 > 0, 7 > 1. 

For the moment, let us forget that m G N and define m = m{r) G M+ by the equality r = a~^, 
i.e., m(r) = (log(r^-'^)/a)-'^/'^. Set also 

Ue{r) = (ea„(^)CJ„(^))"2 = (r/e)^ exp(-2/3(log(r"^)/a)i'/^). 

Observe that Ui.{r) = ^^"'(r) as r = a~^, m G N. On the other hand, one can check that the 
function iieir) is a convex function in for r > small enough. Therefore, ■Ue(r) < u''^^{r) 
as r 7^ for any m G N, and the condition iie(r£) — )• 00 implies Mg"(re) — )• 00. However, it 
is possible that ^^"(r^) — t- 00 when ^^(rg) = 0(1), in general. For instance, let r = 7. Then 

If = and vl'^"'{r^) x 1, then it was noted in Remark 14.151 that v!'^"'{r^{l + 5)) ^ 00 for 
any 5 > 0, but ii£(r£(l + 5)) x 1. The same holds for 7 < r. 

The relation Usife) ^ 1 determines the family r^. Note that if r^/f^ — )• 00, then Ugir^) — )■ 
00, and since ti^*"'(r) > Ue(r), this yields vl'^"'{r^) — )• 00 and 7e(re) — )• by Theorem 14.81 
However, this family is not a family of separation rates, at least if 7 < t, because the 
condition r^/fe — )■ does not guaranty that '^e{fe) — ^ 1- 

More precisely, there exists a sequence — >• and fm = o(f£^) such that 7e„(rm) — )• 0. 
In fact, observe that if 7 < t, then the function Ueir) satisfies (uniformly over e > since 
is a factor in Ue{r)): 

Ue{Br) X u^{r) iff B x 1, r ^ 0. 

Take a sequence m — )• 00 and put = flm^, (j^m"*)^ = '^m(l + <^m), = '"'mi^ + where 
— ^ 0, ^mO'm/'^m-i ~^ ^ > 0. Observe that similarly to evaluations in Remark 14.151 
one has, uniformly over e > 0, 

Ue{fm) X Ue{r^^^) X Ue{rra) = 4'"(rm) < 4*''(?'m^)) < '"e"(^m)> m ^ OO. 

Take now and such that 

^.™(^~rn)^nt(r«))>^l. 

This implies Ue^ifm) ^ Uemi^m) and fm I'm ^ fm- By construction, we see that 
the sequence fm satisfies Uem{fm) ^ 1 and fm = o{fm), but ^^^"(j^m) — ^ c«, which yields 

j4 family of asymptotically minimax consistent tests of simple structure 

The family of tests given by (j4.3p are determined by the sequence {wfcjfcgN given by (|4.2p 
and are rather complicate. Furthermore, as revealed in Remark 14. 14| the condition wq = o(l) 
does not hold under assumption ()4.20p and, hence, these families of tests are rate optimal 
only. We describe below another rate optimal family of tests that is of simpler structure. 

This procedure is determined by a family m = m{r^) such that G Aj^ = [l/om, 1/am-i], 
m G N, m > 2. Take a G (0, 1) small enough and consider the collection Tm,k, 1 < k < m, 
such that 

Tm,m = Tm,m-i = <^'Hi'^-a/Q)), T„,fc = ((1 " ca/(m - A; - l)^)) , (4.25) 
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where c is taking in such way that Y.k=i^~'^ = l/(6c)- (Note that this yields 
Er=i^(-7^m,fc) = «/2.) 

Consider now the following families of events and tests 

ye,a = {y -AVk] <Tm,ke, k = 1,2,... ,m}, V'e,Q = %^^) (4-26) 



where, hereafter, C denotes the complement of an arbitrary set C G M. 
Then, the following statement is true. 

Theorem 4.9 Consider the Gaussian sequence model \2. 2\) and the hypothesis testing prob- 
lem \2. 3|) with the set under the alternative given by \2.4^ with q = 2. Let {cifc}fceN di^-d 
Wk}keN be increasing sequences satisfying \4.2C^ . Then, the family of tests given by \4.26\^ 



with the collection Tm^k, 1 < k < m described by ^.25 ) is asymptotically minimax consistent, 
i.e., ae{il^e,a) < a o.nd one can take ti^*"" = u^^^{r^) — )• oo such that /^^(V'e^a, 0(re)) — 0. 



The proof is given in the Appendix, Section 17.91 

Remark 4.17 It is evident that the statement ae{il^e,a) < a in Theorem 14. 91 holds uniformly 
for each e small enough such that rea2 < 1. From the proof of Theorem 14.91 it is also evident 
that this statement does not depend on the assumption (I4.20p . 



4.7 Mildly ill-posed inverse problems with /''-ellipsoids for Sobolev classes 
of functions: the "sparse" case q E (0,2) 

Here, we consider mildly ill-posed inverse problems with /''-ellipsoids for the Sobolev classes 
of functions, for the "sparse" case q £ (0, 2). As pointed out previously, unlike the "standard" 
case g = 2, the sharp and rate optimality results for the "sparse" case q G (0, 2) are of different 
nature and are not directly linked with Theorem 14.11 but can be obtained from a hitherto 
unknown link with results obtained in another context and presented in Sections 4.4.2-4.4.3 
of [17|. Since these results are scattered in the cited reference, and not not immediately seen 
as ill-posed inverse problems, for completeness and an immediate access to these results, we 
formulate and present them below. 

Consider the extreme problem 

= 2mi^h^smh^{zf/2), (4.27) 

where the infimum is taken over sequences {hi, z-i), h-i G [0, 1], Zi>Q, i G N, such that 

Y,t'Ph.zj>{fl/e% <(!/£"), (4.28) 

where = r^il - 6e), 5e > 0, 5e ^ 0, 5e log(e~^) oo. 

Set A = {a+j3) /2— fi / q. If A > 0, then, there exist extreme sequences hi^e ^ (0, 1], Zj^^ > 0, 
in the problem (I4.27p - (14.28p . and we have the asymptotics of the form 

ul ~ CQuhl, (4.29) 

where the quantities n = and /iq = /io,£ are determined by the relations 

cin^+^'^h]!^ ~ r,/e can^+^+^/^/iJ/'^ ~ l/e, (4.30) 
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for some constants q = q(a,/3, g) > 0, / = 0, 1,2, which, in turn, imply 

Us ~ c3e"(^"+^/^"^/2)/("+'^(^~2/'*')Vp(°+^)+^/'?)/("+^(^-2/'')) (4.31) 

for some constant C3 = 03(0,/?, g) > 0. (The quantity n = — t- 00 plays the role of the 
"efficient dimension" in the problem.) 
Set 

Qe,i = V2(log i + log log i + 2 log log(e-i)) 

and consider the events 

ye = {y = iVihrn ■■ (sup \yi\/{eQe,i)) > 1} (4.32) 
and the following families of test statistics 

kiy) = Uj^ Yl heMy^/^^ ^e,^), ^{t, z) = 6^'/^ cosh(tz) - 1, (4.33) 
iGN 

and tests 

^tH = H.{y)>H}ny,^ V'f = V^,^, = a + (1 - «)%,. (4.34) 

Then, the following statement is true. 

Theorem 4.10 Consider the Gaussian sequence model i2. 2\) and the hypothesis testing prob- 
lem i2. 3]) with the set under the alternative given by ^2.4^ with q £ (0,2). Let at = A:" and 
ak = , k £N, a > 0, /3 > 0, and set A = (a + /3)/2 - (3/q. Then 

(a) If X > 0, then the sharp asymptotics are of the Gaussian type \2.8\) with Ug from 
l^4-27\ ). The tests ipfjj of the form with H = H^"'^ and H = Ug/2 are asymptotically 
minimax, i.e., 

Oie{'il^^^H(c)) < a + o(l), 

/3e(e(r,),V'^%)) = /3,(r„a) + o(l), 
7e(e(r,),^^^„_^/2) = le{rs)+o{l). 

(b) If X < 0, then the sharp asymptotics are of the following degenerate type 

f3e{re,a) = {l-aM-De) + o{l), 
7,(r,) = ^-D,) + o{l), 

where 

De = n-^re/e - \/21og(n,), = r.-^/". 

The tests and (the randomized) tests ipe^a of the form i4-34^ are asymptotically minimax, 
i.e., 

ae(V'i^a) = a + o(l), 
/3,(e(r,),Vi;'j = /3.(r„a) + o(l), 
7.(e(r,),Vf) = 7.(r.) + o(l). 

(c) If X > 0, then the separation rates are of the form 

^* ^ g(2a+l/<?-l/2))/(2(a+,3)+l/g)_ 

(d) If X < 0, then the sharp separation rates are of the form 

r* = Ae°/("+'')(log(e-^))"/2(a+/3)^ ^ ^ (2/(a + /3))"/2("+/3). 
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The above theorem can be obtained by taking into account the general minimax hypoth- 
esis testing framework considered in Section [2] and Theorems 4.5 and 6.1 in |17J, and noting 
(from their proofs) that the events (thresholding rule) (4.155) in |17] can be replaced by the 
events (thresholding rule) ()4.32p . Its proof is omitted. 

Remark 4.18 Similarly to Remark 14. 31 we get the sharp asymptotics (j4.3ip for the sequences 
o-k ~ and (Tfc ~ A;^, /c G N, a > 0, /3 > 0, and similar rate asymptotics for the sequences 
Ofc X A;", cr X /c'^, A; G N, a > 0, /3 > 0. In both cases, the separation rates are still of the 
form given in Theorem 14.101 

5 Minimax signal detection in ill-posed inverse problems: 
adaptivity and rate optimality 

The families of tests described in Section 14.1 I f except those described in Theorem 14. 7p de- 
pend on a parameter /t G S C x (0,2], n > 2, associated with the sequences {afcjfcgN 
and {cTfclfcgN) and q G (0,2], that are involved in the ill-posed inverse problems under 
consideration, that is usually unknown in practice. For example, if aj. = exp{ak'^) and 
cjfc = exp(/3A;'^), /c G N, a > 0, r > 1, /3 > 0, 7 > 1, and if g G (0,2], then 
At G S = {(a, r, p, 7, q)} = (0, 00) U [1, 00) U (0, 00) U (1, 00) U (0, 2]cR\x (0, 2]. 

Therefore, it is of paramount importance to construct families of tests that do not depend 
on the unknown parameter k and, at the same time, provide the best possible asymptotical 
minimax efficiency. These families of tests are called adaptive (to the parameter k), and the 
formal setting is as follows. 

5.1 Adaptive distinguis ability and adaptive separation rates 

Let a set S = {k} and a family ^^(k), k G S, be given, where e > is small. Let the set 
0e(K, re(K)) be determined by the constraints (|2.4p with = ak{K), = ^■^(k). A; G N, 
q = qi^K), and = r^^n), and set 

e,(S) = J G,(K,r,(K)). 

We are interesting in the following hypothesis testing problem 

Hq : r/ = 0, versus Hi : r] £ @s{T,). 

We are aiming at finding conditions for either 7e(0£(S)) — )• 1 or j^^Qi^CE)) — )• 0, and to 
constructing asymptotically minimax adaptive consistent families of tests il^^'^ such that 
7,(ee(S), ) ^ as 7e(ee(S)) ^ 0. 

Let U£{k) = Ue{K,rfr{K)) be the value of the extreme problem (14. ip for the set 0£ = 
6e(K,r£(K)). Set 

ne(S) = inf Ue{K). 

We are interesting in how large ne(S) should be in order to provide the relation 7e(0e(E)) — )• 
0. We say that the family (S) — )• 00 characterizes adaptive distinguishability if there 

exist constants < d = d{Ti) < D = D{T,) < 00 such that 

7£(0£(S)) ^ 1 as limsup^^^Us{K)/uf < d, 
7e(ee(S))^0 as limmf^(.sUeiK)/uf > D. 
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We call a family v'^'^^k), k G S, such that u"'^ x Ue{i^: r^°'(K)), the family of adaptive separation 
rates. 

Note that the relation 'y^{Q^(T,)) — )• is possible if ^^(S) — )• oo. It was shown in Theorem 
14.71 that this relation suffices for the construction of minimax adaptive consistent families of 
tests for mildly ill-posed inverse problems with the class of analytic functions. However this 
implication does not hold in the remaining ill-posed inverse problems under consideration. In 
these cases, adaptive distinguishability conditions and adaptive separation rates are sought, 
and they are the goal of the subsequent sections. In contrast to Theorem 14. 7( there is price 
to pay for the adaptation. We show that n"'^ = y^log loge"-*^ for the mildly ill-posed inverse 
problems with the Sobolev class of functions and u"'^ = log log for other problems under 
consideration (except the case mildly ill-posed inverse problems with the class of analytic 
functions). These yield a loss in the separation rates in terms of an extra ylogloge^ factor 
for the mildly ill-posed inverse problems with the Sobolev class, and in terms of an extra 
Y^log loge~^ factor for severely problems with analytic classes of functions. A similar loss in 
the separation rates for a well-posed signal detection problem was first observed in [25j. 

As we shall show below, the derived families of tests are of simple structure. In particular, 
for the mildly ill-posed inverse problems with the Sobolev class of functions, these are of the 
form 

V'f = ]I{sup,t,,„„>H,}, mfc = 2^ Hk = VClog{k), k>L, C>2, 

where L = L^, — ?• oo, is an integer- valued family and ts^m are centered and normalized 
version of x^-statistics that correspond to the first m observations {yi,y2, ■ ■ ■ ,ym) in (II. 3p . 

For the severely ill-posed inverse problems with the Sobolev class of functions or the class 
of analytic functions, the derived families of tests are of the form 

ijf = Ti{sup,\y,\>eH,}, = yj2\og{k), k < L, Hk = VClog{k), k>L, C>2, 

where L = L^, — )• oo, is an integer- valued family. 

Finally, for the severely ill-posed inverse problems with the generalized analytic class of 
functions, the derived tests are of the form 

i^f = I{sup;, \yk\>eT,^k}, T^,k = max {Ts, \/2(log(A;) + log log(A;))) 
for a family — )• oo. 

5.1.1 Mildly ill-posed inverse problems vjith. the Sobolev class of functions 

Consider first the "standard" case q = 2. Let = k'^ and = k^ , k ^ N, a > 0, /3 > 0. Set 
K = {a, 13) and let S be a compact subset of M^. We show that, under a weak assumption 
on the set S, 

uf = Vloglog(e-i). 
This corresponds to the adaptive separation rates 

rf{K) = (e^loglog(e-i))^"/(^'"+^^+i). (5.1) 

The rate optimal adaptive family of tests is of the following structure. Take a collection 
rrifc = 2^, k £ 'N, k > L = with the integer-valued family — )• oo, = o(log(e~"'^)), 
and take a family of test statistics te,mj. of the form ()4.12p . Consider the following families 
of thresholds and tests 

Hk = VClogik), ye = {y: t^,™, < Hk, V > LJ, = % , C > 2. (5.2) 
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Denote also 

= 4^ + 4^ + 1 ^ <t>{^) = {^(^) : « e S} C (0, oo). (5.3) 
Then, the following statement is true. 

Theorem 5.1 Consider the Gaussian sequence model h2. 2\) and the hypothesis testing prob- 
lem h2. S^) with the set under the alternative given by ^2.4^ for q = 2. Let = k°' and 
ak = k^, k en, a>0, p > 0. Then 

(a) (lower bounds) Let the set (p{Ti) given by i5.3\) contains an interval [a,b], < a < b < 
oo. Then, there exists constant d> such that if lim sup^g^ U£{k) / y^log log(e~^) < d, then 

7e(e,(s)) ^ 1. 

(b) (upper bounds) For the family of tests ips given by ( 15. a{ips) = o(l) (^''^d there 
exists constant D = D{T,) > such that if liminf^es ^e('^)/\/loglog(e~^) > D, then 

/?,(V.,e,(s)) = o(i). 

(c) (adaptive separation rates) The adaptive separation rates r'^'^{n), k G S, are given by 
The proof is given in the Appendix, Section 17.101 

Remark 5.1 In view of Remark 14.31 similar rate optimality results and the same adaptive 
separation rates hold for the sequences ~ /c" and a ~ k^ , A; G N, a > 0, /3 > 0, and the 
sequences x A;" and cr x A;'^, A; G N, a > 0, /3 > 0. 

As in the case of rate and sharp asymptotics, unlike the "standard" case q = 2, the 
"sparse" case q G (0, 2) is not directly linked will Theorem 14 . II and . hence, adaptive separation 
rates for the "sparse" case q G (0,2) will be considered separately in Section [H (In fact, 
adaptivity results for the (more general) Besov class of functions will be presented therein.) 



5.1.2 Severely ill-posed inverse problems with the class of analytic functions 

Let Ofc = exp(aA:) and = exp{/3k), A: G N, a > 0, /3 > 0. Set k = {a,l3,q) and let S be a 
compact subset of x (0, 2]. We show that, under a weak assumption on the set S, 



ad 

''£ 



ur = log log (e ^] 



This corresponds to the adaptive separation rates 

rf{K) = (ev'loglog(e-i))"/("+^). (5.4) 

The rate optimal adaptive family of tests is of the following structure. Take an integer- 
valued L = Le with Lit — )• oo, = o(log log(e~^)). Consider the following families of 
thresholds and tests 



H,= H^^^; ys = {y- \yk\<eH,}, A = ^y^, C>2. (5.5) 

IV<^log(A;), k>L, 



Denote also 



^(^)= n( ^m ' </'(S) = {0('^):^GS}c(O,oo). (5.6) 
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Theorem 5.2 Consider the Gaussian sequence model h2. 2\) and the hypothesis testing prob- 
lem h2.3\) with the set under the alternative given by i2.4\ )- Let = exp(afc) and 
(Tfc = exp(/?/c), A: G N, a > 0, /3 > 0. Then 

(a) (lower bounds) Let the set (/>(S) given by ^5.0(l contains an interval [a, 6], < a < 6 < 
oo. Then, there exists constant d > such that i/ limsup^gj] losC^""*^) ^ then 

7.(e,(E)) ^ 1. 

(b) (upper bounds) For the family of tests ips given by i5. 5\) . = o(l) and there exists 
constant D = D{T,) > such that z/liminf^eE 'tiE('t)/ log log(e^"'^) > D, then /3£(0£(S), -(/'g) = 

0(1). 

(c) (adaptive separation rates) The adaptive separation rates r"'^(K), k G S, are given by 
The proof is given in the Appendix, Section 17.111 

Remark 5.2 In view of Remark [531 similar rate optimality resuhs and the adaptive separa- 
tion rates ()5.4p hold for the sequences ak x exp(a/c) and a x exp(/3/c), G N, a > 0, f3 > 0. 



5.1.3 Severely ill-posed inverse problems with the Sobolev class of functions 

Let Ok = A;" and ak = exp(/3A;), A; G N, a > 0, f3 > 0. Set k = {a,/3,q) and let S be a 
compact subset of x (0, 2]. We show that, under a weak assumption on the set S, 



ad 



uT = log log (e ^] 



This corresponds to the adaptive separation rates 

^ad(^) ^ / 21og(£-i) - 2aloglog(£^i) - logloglog(£-i) \ ^ /log(£2^\ 



2/3 y V /5 

The rate optimal adaptive family of tests is of the following structure. Take an integer- 
valued L = Lg with Lg — )• oo, = o(log log(e^^)), and consider the families of thresholds 
and tests given by (jS.Sp . 



Theorem 5.3 Consider the Gaussian sequence model h2. 2) and the hypothesis testing prob- 
lem i2.3\) with the set under the alternative given by ^2.4^ . Let = and ak = exp{pk), 
k eN, a>0, /3 > 0. Then 

(a) (lower bounds) Let the set T, contains an interval of {a, (3) : (3 G [1/26, l/2a], 
< a < 6 < oo, and a fixed a > 0. Then, there exists constant d > such that if 
limsup^gs«£('^)/loglog(e~^) < d, then -fe{&e{^)) 1- 

(b) (upper bounds) For the family of tests ip^ given by 115. 5\) . a{ips) = o(l) and there exists 
constant D = -D(S) > such that i/liminf^es 'We(K)/ log log(e~"'^) > D, then /^^('i/'e, OeCS)) = 

0(1). 

(c) (adaptive separation rates) The adaptive separation rates r'^'^^n), k G S, are given by 
The proof is given in the Appendix, Section 17.121 

Remark 5.3 It is worth mentioned that a stronger result is possible in this case. In view 
of (j7.18|) . the relation (j5.7p determines sharp adaptive separation rates r^'^{K), k G S, in the 
following sense. 

(a) If liminf (re(K)/r"^(K)) > 1, then Ug — t- oo, i.e., 7e(re) — t- 0. 

(5) If limsup (re(fi;)/r"°'(K;)) < 1, then Us — )• 0, i.e., 7e(re) — t- 1, and the minimax testing 
is impossible. 
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Remark 5.4 In view of Remark 14.8^ similar rate optimality results and the adaptive sep- 
aration rates (j5.7p (as well as the sharp adaptive separation rates mention in Remark 15. 3p 
hold for the sequences ~ and a x exp{/3k), k £ N, a > 0, (3 > 0. 

5.1.4 Extremely ill-posed inverse problems with the class of generalized analytic 
functions 

We consider the case q = 2 only. By the results of Section 14.61 in order to obtain distin- 
guishability conditions, we can replace Us{k), k G E, by ^^^(k) = n^*"(K, r£(K)), determined 
by (I4.22p . for = afc(K) and ak = akin), k £ N. Set 

4-(S)= inf nf (k). 

We are interesting in how large n^'"(S) should be in order to provide the relation 7e(0e(S)) — )• 
0. 

Assume below the uniform version of ()4.20p : let ^"^(k) and ak{K), A; G N, be increasing 
sequences such that, for all k G E and some constants < b < B, 

b<ai{K)<B, b<ai{K)<B, (5.8) 

and, for some increasing sequence Tfc > 1, Tfc — )• oo and some cq > 1 for all k G S and k £ N, 

ak+i{n)/cFk{K.) > Tfc, afc+i(K)/afc(«;) > cq. (5.9) 

Similarly to u'^'^, one can consider a family w^*^^ which characterizes adaptive distinguisha- 
bility. We show that, under some assumption on the set S, one has 

<:, = loglog(e-i). 

For K G S and for A > large enough, let an integer m = m{A, k) be defined by the 
relations 

am~-liK)am^l{K) < A < amiK)am{K.). (5.10) 
Under (j5.8p and (|5.9p . one has 

m~2 



^ n 



k=l 

which yields 

sup m(^, k) = o(log(yl)) as ^ — oo. (5-11) 

Set 

M{A, S) = {miA, k) G N : K G S}, M{A, S) = #(7W(A S)). 
Since M{A, S) < max„g_vi(A,s) one has, by (15. lip . 

M(^,S) = o(log(^)), as A^oo. 

Let m = m{A, k) be defined by (|5.10p and set L{A, S) := sup^g^ log(m(^, k)). By ()5.1ip we 
have, as A — )■ oo, 

limsupL(^,S)/loglog(^) < 1. (5.12) 
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For the lower bounds we suppose one can find quantities 6 > 0, C > 1 such that 

liminf log(M(^,S))/loglog(A) = b, sup rs(K)) < C74*"(S). (5.13) 

(The first relation in (15.13P is fulfilled for the example mentioned in Remark 14. 161 at least if 
the set S = {{a,T, f3,j)} contains an interior point.) 

The rate optimal adaptive family of tests is of the following structure. Take a family 
Te — oo such that = o(y^log log(e~^)), and take a family of sequences T^^k of the form 



r,,fc = max [T„ V2(log(A;) + loglog(A;))j . 

This family satisfies 

Consider the following families of events and of tests 

ye = {y: \yk\ < eT.^k, V A: e N}, V. = (5.14) 
Then, the following statement is true. 



Theorem 5.4 Consider the Gaussian sequence model h2. 2\) and the hypothesis testing prob- 
lem i2. 3\) with the set under the alternative given by \2.4^ for q = 2. Let {ak}k&i o,nd {(Jk}k&i 
be increasing sequences satisfying h5.^) and h5.9^) . Then 

(a) (lower bounds) Assume \5.13\l . Then, there exists a constant d > such that if 
limsup4*"(E)/loglog(e-i) < d, then je{Qe{^)) ^ 1- 

(b) (upper bounds) Assume i5.12\) . For the family of tests Tps given by ^5.14^ , there exists 
a constant D > such that if u^^'^iTj) > D log log(e^^), then je{'S)e{^),i^e) = o(l). 

(c) (adaptive separation rates) The adaptive separation rates r^'^{K), k G S, are deter- 
mined by the relation n^*^^ x u^*"'(k, r"'^(K)). 

The proof is given in the Appendix, Section 17.131 



6 Mildly ill-posed inverse problems with the Besov class of 
functions: the "sparse" case q G (0, 2) 

The various ill-posed inverse problems considered in Sections [T]l5l under the Gaussian white 
noise model (ll.ip . are based on the SVD of the involved operator A. However, it is well 
know that although offers a kind of diagonalisation, SVD has its limitations rooted in the 
fact that the resulting eigenfunctions derive from the operator A, not from the function / to 
be recovered. Unfortunately, it is in general impossible, although it would be very pleasant, 
to have a system of eigenfunctions which simultaneously diagonalizes both A and the a-priori 
regularity of /. On the other hand, [9j showed that there exists a WVD of a special class of 
homogeneous operators (such as integration or fractional integration), that simultaneously 
quasi-diagonalises both the operator A under study and the a-priori regularity of the function 
/ to be recovered (see, also, [1]). 

In view of the above discussion, under the Gaussian white noise model (jl.ip . we also 
consider the signal detection problem for mildly ill-posed inverse problems with Besov classes 
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(bodies) of functions, B^^, a > 0, q £ (0,oo), t G (0,oo), that arises naturally through 
WVD when A is assumed to belong to the special class of homogeneous operators mentioned 
above. Restricting again our attention to the "sparse" case q £ (0,2), both rate and sharp 
asymptotics for the error probabilities in the minimax setup are studied. Both minimax 
rate-optimal non-adaptive and adaptive tests are also constructed. 

6.1 WVD, Besov spaces and the Gaussian sequence model 

For a special class of homogeneous operators A acting on Hilbert spaces, [9] showed that 
an WVD exists that involves three set of functions, an orthonormal (regular) wavelet basis, 
and two near-orthogonal sets, {uu}ueA and {vu}u£A, that satisfy certain biorthogonality and 
near-orthogonality relations (see (10)- (12) in [9]), and the following quasi-singular relations: 

where the set A. = {v : u = j G N, 2 = 1,2,..., 2^} be of dyadic structure, {j and i 

correspond to be the resolution and spatial indices, respectively), Kj be the the quasi-singular 
values (depending on j but not on i). 

Consider the Gaussian white noise model (jl.ip and assume that / belongs to the Besov 

ball 

B^/L) ={eel^ : <L}, a > 0, q€ (0,oo), t G (0,oo), L > 0, 
where the wavelet coefficients 9 = {Ox}xeAi = if^i'x), A G A, satisfy 

l^lg,t= ' «>0' 9>0' *>0' 

jeN i=l 

with obvious modifications for the cases q = oo and/or t = oo. Under a regular enough 
(i.e., a number of vanishing moments and continuous derivatives) wavelet basis {^|J\}x^\ in 
L2(0, 1), the Besov norm | • 1^^^ in the sequence space is equivalent to the Besov norm || • H^^^ in 
the function space (i.e., in L2{0, 1)), with the smoothness parameter a = a — 1/2 + 1/q > 0, 
g G [1, oo], t G [1, oo]. 

Note also that the Besov norm | • (i.e., for t = q) is equivalent to the Sobolev norm 
I • \a,q, and that there are not direct relationships between the Besov norm || • ||g ^ and the 
Sobolev norm || • \\a,q in L2(0, 1); however the following relation exists: for some constants 
ci > and C2 > 0, not depending on /, 

Cl||/||^,oo<ll/lk,<C2||/||^,l. 

(See, e.g., [T7], Section 2.7, and references therein). 

Assume now that, in the Gaussian white noise model (jl.ip . A belongs to the special class 
of homogeneous operators mentioned above. Then, according to (35)-(36) in |9], the following 
Gaussian sequence model emerges 

Uu = 9u + £ cTj G A, (6.1) 

where yy are the empirical WVD coefficients, aj are the reciprocal of the quasi-singular values 
Kj, and are iid AA(0, 1)) random variables. 
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6.2 Rate and sharp optimality results 

Let now = 2°-' , a > 0, and take cjy = 2^^ , /3 > 0, in (|6.ip . The latter sequence (of variances) 
arise as the reciprocal of the quasi-singular values of certain homogeneous operators using 
the WVD (see Theorem 3 in [9]). (On replacing the indices j G N, i = 1,2,. . . ,2^ , by 

k = 2^ + i, then we get k^-' , /? > 0, A; G N, justifying the term mildly ill-posed inverse 

problem used above.) 

In view of the above, the alternative set (12. 4p is now determined by 

G,(r,) = {t? e ^2 . |^|^_^^^^^^ < 1, 2,2 > rj. (6.2) 

Consider the extreme problem 

u] = inf 2-''^^^^ sinh2(z2/2), (6.3) 

where the infimum is taken over sequences {hj, Zj), hj G [0, 1], Zj > 0, j £ N, such that 

^ 2^(^^+'^h,z] > {rl/e^), J2 2^'^-+^^+'/''^^hfz'j < (1/e*), (6.4) 
j£N jeN 

where = re(l — (5^), 5s > with — 0. 

Set A = (a -|- /3)/2 — /3/g. If A > and q < t, then, there exist extreme sequences 
hj^s £ (0, 1], Zj^s > in the problem ()6.3p - (l6.4p and we have the asymptotics 

n2~co2^o/i2, (6.5) 
where the quantities /iq and jo are determined by the relations 

c^2io(/3+i/2)/,i/2^^^/^^ c^2M»+P+iMhl/i ^l/^^ (6.6) 

for some positive, 1-periodic functions (in Jq) ci = ci{a, I3,q,t, j^) > 0, / = 1,2, which, in 
turn, imply the asymptotics of the form (|4.3ip for some positive, 1-periodic function (in jg) 
C3 = C3{a,P,q,t,jo). 
Set 

Qs,j = V2(jlog(2) + log j + 21oglog(e-i)) 

and consider the events 

ye = {Vv = {Vij} ■■ sup max \yij\/eQs,j > 1}, (6.7) 

jeN l<i<2J 

the family of test statistics 

2J 

ls{y) = ^e^^^ejljiVj^Zej), IjiVj^z) = ^{Vij / ^, z) , ^{t, z) = COsh(tz) - 1, 

(6.8) 

and the family of tests of the form (j4.34p with events and test statistics defined, respectively, 
by dlZI) and (fOD . 

Then, the following statement is true. 
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Theorem 6.1 Consider the Gaussian sequence model h2. ^|) and the hypothesis testing prob- 
lem h2.3\) with the set under the alternative given by 116. S^) with t > and q E (0,2). Let 
Oy = 2"^' and = 2^^', j G N, a > and /3 > 0, and set A = (a + /3)/2 - ji/q. Then 

(a) If X > and q<t, then the sharp asymptotics are of the Gaussian type 1^2. 8\) with 
from i6.3\) . The tests ip^^j of the form ^-34^ with H = H^°^'> and H = Me/2 are asymptotically 
minimax, i.e., 

ae{ilJ^^^(^)) < a + o{l), 
/3e(e(re),^^^^(.)) = Pe{re,a)+o{l), 

lemre),i^f,u,/2) = le{re) + 0{l). 

(h)If A < and t < q or if X < and t > q, then, there exist constants Ci = 
ci{a, I3,q,t), ci > 1 > C2 > 0, such that 

(1 - aM-De,cr) + o(l) < /3eire, «) < (1 " a)^-De,c,) + o(l), 
H-De,c,) + o{l) < 7.(re) < H-De,c,) + 

where 

The tests and ip^^a of the form lji4-34\ ) determine the upper bounds, i.e., 

<^e{tPe,o) = a + o(l), 

I3e{0{re),^?,c.) < (l-a)$(-i?.,c.) + o(l), 
7.(e(r,),V^f) < ^-D,,,,) + o{l). 

(c) If X > 0, then the separation rates are of the form (this holds for q > t as well) 

^* ^ g(2a+l/q-l/2))/(2(a+/3)+l/g)_ 

(d) If X < and t < q or if X < and q < t, then the separation rates are of the form 

r* =e"/("+'^)(log(e-i))"/2("+/3). 

Moreover, there exist constants Ai > A2 > such that 

if liminf Tg/r* > Ai then /^^(re, a) 0, 7e(r£) 0, 

and 

if limsupre/r* < A2 then /3e{re,a) 1 - a, 7e(re) 1. 

The above theorem can be obtained by using the general minimax hypothesis testing 
framework considered in Section [2] and Theorems 4.6 and 6.2 in [17]. Its proof is omitted. 

Remark 6.1 Similarly to Remark 14.31 we get the sharp asymptotics (16. 3p for the sequences 
Ojy ~ 2"-' and a,^ ~ 2^^ , j G N, a > 0, /3 > 0, and similar rate asymptotics for the sequences 
X 2"-' and ctj^ x 2^^ , j G N, q > 0, /3 > 0. In both cases, the separation rates are still of 
the form given in Theorem 16.11 

Remark 6.2 Observe that the tests and tp^^ of the form ()4.34p . with events and test 
statistics defined, respectively, by (16. 7p and ()6.8p . do not depend on a, f3 and q, that determine 
the particular ill-posed inverse problem and the class of functions, i.e., these tests are adaptive 
(with respect to a, /3 and q) in the region A < 0. 
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6.3 Rate-adaptive optimality results 

As pointed out previously, unlike the "standard" case q = 2, similar to the sharp and rate 
optimality results, adaptivity results for the "sparse" case q £ (0, 2) are of different nature 
and are not directly linked with Theorem 14. 11 but can be obtained from a hitherto unknown 
link with results obtained in another context and presented in Sections 7.1.3 and 7.4.1 of [17]. 
For completeness and an immediate access to these results, we formulate and present them 
below. 

Let Qu = 2"^ au = I^^K J e N, a > 0, /3 > 0, k = (a,/3,g), q € (0,2), r = {k,1) G S, 
where S is a compact subset of x (0, 2) x M_|_. Set A = A(k) = (a + /3)/2 — and recall 
from Remark 16.21 that if A < 0, then the tests 'i/'i^j '^^a provide distinguishability and do not 
depend in r, i.e., these tests are adaptive and we have no losses in the separation rates. 

Assume now inf^-es A(k) > 0. Then, as in Section [5.1.H one can show that 



which, in turn, by results of Section 16.21 yields the following adaptive separation rates (de- 
pending on K only) 

rf{K) = £(2-+l/<?-l/2))/(2(a+/3)+l/g) ^ ^ ^ £ ^log log(e-l) . (6.9) 

We now construct a family of tests that are rate-optimal adaptive. First, let 

V'e.o = ^£,0 = {Vp = {Vij} ■ sup max {\yij\/ {eTej) > 1}, (6.10) 

Jyro;;^, ifj<J.,o, , , 1 -1 1 o 

,j = { 1 ^,^ , ^ . / > Je,o;<logloge \ (:7 = log2. 

[V2(Ci + logj), ifj>J,,o 

Next, for j > Jsfi, consider the test statistics 

2i 



where 



;^=2-(^+i)/2 5^(4/5^-1), 



and set 

V',,! = Ye,x = {Vu = {y^j} : sup Ij/T, > 1}, T, = 2yb^. (6.11) 

Lastly, fix a small enough value c G (0, (log2 2)/4) and take 

K = K{j) = (logj)/2, K{c,j) =K + cj. (6.12) 
For all resolution levels j such that 

^£,0 < J < Je,i ^ (logloge"^)loge"\ 
let us consider the collection of test statistics 

2J 2J 



kk = T.^ij,k = (2^^+isinh2(z2j2))-i/2^e(y^,A,^i,fc), 1 < A: < K{cJ), 

1=1 



1=1 1=1 

where 



VFT^, K < k < K{c,j). 
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Set 

V'ej.fc = '^l,,k>tj, tj = \/51og j, 
and consider the family of tests 

V'e = max{'0e,o, V'e.i, max max '4's:j,k}- (6.13) 

Je,0<j<Je,l l<k<K{c,j) 

Then, the following statement is true. 

Theorem 6.2 Consider the Gaussian sequence model h2. 2\) and the hypothesis testing prob- 
lem 12. 3\) with the set under the alternative given by W.S^) with q G (0, 2) . Let Ou = 2"-' and 
= 2^^ , j G N, a > 0, /? > and t > 0. Set X = A(k) = (a + /3)/2 - f3/q and assume that 
infT-es A(k) > 

(a) (lower bounds) Set 0(t) = a + (3 + l/2q and assume there exists set Eg C S such that 
the set 0(So) = {4>{t), t G Sq} C M+ contains an interval {a,b), < a < b. Then, there 
exists a constant c = c(S) > such that if limsupsup^^Y,^ u'^{t, Pi;{t))/ logloge^^ < c, then 
Pe{a, 0£(S)) ^ (1 - a) for all a G (0, 1) and -fe{&e{^)) ^ 1- 

(b) (upper bounds) For the family of tests ipe given by i6.13\) . there exists a constant 
C = C(S) > such that z/ liminf n^(S)/logloge~^ > C, then, one has as{ipe) = o{l) 
and 0e(S)) = o(l). These relations imply /3e(a,Be(S)) = o(l) for all a G (0,1) and 

7e(e,(S))=0(l). 

The above theorem can be obtained by using the general minimax hypothesis testing 
framework considered in Section [21 the adaptive setup considered in Section [5l Theorem 7.2 
in |17j and the family of tests in Section 7.4.1 [17], and noting that although the assumption 
in Theorem 16.21 (a) is slightly wider than the one in Theorem 7.2 in [17J it suffices for the 
lower bounds in the case under consideration. Its proof is omitted. 

Using Theorem 16.21 the following relations, with adaptive critical radii given by (16. 9p . are 
easily obtained. 

Corollary 6.1 Under the formulation in Theorem \6.^ then 

(a) (lower bounds) There exists constant d = d{Ti) > such that if 
limsupsup^g2^£('^)/''e,ad('^) < ^' i/ien /3e (a, 6^ (S)) 1 - a and 7e(Ge(i;)) 1. 

(b) (upper bounds) There exists constant D = D{Ti) > such that if 
liminfinf,6sre(T)/r*^^(K) > D, then /3,(a,ee(S)) ^ and 7e(0e(S)) ^ 0. 

(c) (adaptive separation rates) The adaptive separation rates rf^{K), k G S, are given by 

(KM) 

Remark 6.3 In view of Remark 16.11 similar rate optimality results and the same adaptive 
separation rates hold for the sequences Cjy ~ 2"^ and ~ 2'^-', j G N, a > 0, /3 > 0, and the 
sequences x 2"^ and iTj, x 2^-'', j G N, a > 0, /3 > 0. 

Remark 6.4 As pointed out in Section [6. H for q = t, the Besov norm | • is equivalent to 
the Sobolev norm | * |a,g* Furthermore, the adaptive rates in Theorem 16.2] do not depend on t 
associated with the Besov norm. Hence, the same rate-adaptive optimality results hold true 
for Sobolev classes of functions with /'^-ellipsoids, q G (0,2). 
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7 Appendix: Proofs 
7.1 Proof of Theorem \4.1\ 

To prove the theorem, we utihze techniques and results presented in Chapters 3 and 4 of |17j 
for minimax hypothesis testing in infinite dimensional settings. In particular, in order to get 
the lower bounds, we replace the minimax problem by a Bayesian one. Let vr = be a prior 
(probability measure) on the sequence space such that 7r(0(re)) = 1. Let Pe^-^ = E-j^^P^^r}) be 
the mixture over vr and L^^t^ = dPe^Tr/dPefi = Ej^dPe^ri/ dPsfi be the likelihood ratio. Denote by 
I3{Pq,Pi, a), 7(Po) -Pi) the minimal type I error probability for a given level a and the minimal 
total error probability, respectively, for testing the simple null hypothesis Hq : P = Pq against 
the simple alternative hypothesis Hi : P = Pi, for the measure P of the observations. It is 
well known (see, e.g., [T7], Section 2.4.2) that, for any a E [0, 1], 

/3,(e(r,), a) > /3(P,,o, Pe,., a), 7e(e(r,)) > 7(P,,o, Pe,.) = 1 - ^WPefi - PsAi^ (7.1) 

where ||i-*e,o — -f£,7r||i = -E'e,o|-^£,7r — 1| is the variation distance. Therefore, as e — )• 0, in order 
for 7e(0(r£)) — 1, it suffices ||-Pe,o — -fe,7r||i ~^ 0. Since 

\\Pefi — Pe,TT\\i < ||-fe,0 — -fe,7r||2 = -^e,o(-^e,7r)^ — 1, 

it suffices £'e_o(-^£,7r)^ — >• 1- By ()2.5p . this leads to /3£(0(re)), a) — )• 1 — a. Also the relation 
i?£^o(-^^e,7r)^ = 0(1) implies liminf 7e(r£) > and ^^{r^, a) > 1 — a for any a G (0, 1), see \17\ . 
Proposition 2.12. 

To proceed, we need a definition. A set V is called sign- symmetric (or ortho symmetric) 
if f = {fijigN G y 1 then v = {±.Vi}i^^ G V for all changes of signs of the coordinates. 
Observe now that ©(r^) is a sign-symmetric set. For r] G ©(r^), let us consider the product 
prior VTe = IlfceN^e.fc' where VTg^fc = ^(^r;^ + S-rn.), /c € N, are symmetric two-points priors. 
Note that, vrj(0(r£)) = 1 by the sign-symmetric condition. Let Pe\rjf, be the measure for 
yk = m + eCfc, Cfc ~ AA(0, 1), ken, and 

= dP,^'l/dP^'^ =eMi-vl/2e' + Vkyk/e')), 

Simple calculations give EefliE^.ili^))^ = coshirjl/s^), E N. Therefore, using the in- 
equality cosh(t) < exp(t^/2) (which follows from Taylor's expansions), we have 

E,,o{Li^) = E,,oUE^M':lf = ll^^'^^-M':Lf 

keN fceN 
= n ^oMvl/e') < eMe-' E ^^^2) ^ 1, 

keN keN 

if u'^{r]) = ^£~^^keN''^k ~^ 0' ^^'^ order to get the best r] G ©(r^) we use the extreme 
problem (|4.1|) . Also if n^(r/) = 0(1), then we get E^^q{L1^) = 0(1). This completes part 
(l)(a) of the theorem. 

In order to get the sharp lower bounds, take vr that corresponds to the extreme sequence 
% of the problem ()4.ip . In order to get the relation 

UPefl:Pe,..a)>^{H'^^^ -Ue) + 0{1), ^e{Pefi,Pe,^)>2^{-Ue/2)+o{l), 
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it suffices to sliow tliat 

log(L,,,) = -ull2 + u,i, + (7.2) 

wliere = Usifje) = 0{1) and ~^ C ~ -^(0) 1)) (^e — >• in P^^o-probability (see |T7j, Section 
4.3.1). Setting Xe^k = Uk/^, Ve,k = Ve,k/£, /c S N, we note tliat X^fceN^efc ~ ^tt^. We liave 

log(Le,^) = ^(-t>g^fc/2 + log(cOsh(x£,fct>e,fc))). 

fceN 

Using the inequality | log(cosh(t)) - /2 + t^/l2\ < Bt^, t £ M, for some i? > 0, we have 
(j7.2p with Se = (^£,1 + ^£,21 where 

^ km fceN fcGN 

Since x^^k ~ A/'(0, 1), k £ 'N, under P^^, the relations 6^,1 — ?• 0, 5e^2 — ^ follow from 
-S'e.O'^e,! = and, for some constants Bi > 0, 1 = 1, 2, 3, 4, 

Var,,o<5e,i = i?i <fc < i?2^^>o' = o(l), i^e.O'Je.S = ^3 ^ <fc < B^u^^wo = o(l), 

fcGN fcGN 

since (J^^a > 0. Also, E^^^^ = 0, Vare^oCe = 1 aiid the asymptotic A/'(0, 1) normal- 
ity of ^£ under Pg^o follows from Lyapunov condition: if z^^k = "^e ki^'e k ~ ^) then 
^^gpjE'j^o-s^e fc/(X^fc-^£,o-2^£fc)^ — Bwq — for some B > 0. This completes the lower bounds 
of part (l)(b) of the theorem. 

In order to obtain the upper bounds let us calculate the expectations and variances of 
the statistics of the form (j4.3p for a sequence = fjf^/u^, > 0, /c G N, Ylken'^k ~ 
1/2; Wo = sup^gpjtDfc G (0,2^^/^], where fj and are the extreme sequence and the extreme 
value in (14.111. We have 



fcGN 

Var^,^te = 1 + 4e-2 ^ ^,2^2. ^ < Var^.^t^ < 1 + '^he{r])wo. (7.4) 

fcGN 

The key point is the following lemma. 
Lemma 7.1 

inf heii]) = Us. 

r;Ge(r^) 

Proof. Denote Tk = rj^, ^fc = k £ 'H, w = {wk}k&i and consider the set T = {r = 
{''"fclfcGN : f] = {%}fcGN £ ©(^'e)}- Observe that T is a convex set (i.e., Q{rs) is a quadratically 
convex set) in the sequence space I2 and hs{ri) = e~'^{T,w) = e~^(r,f)/(\/2||T||), where (•,•) 
and II • II stand, respectively, for the scalar product and the norm in l2- We have to check 
that G := infT-gT(''"7 t) = ||t|P, where 

fGT, ||f|| = inf ||r||. (7.5) 

tgt" 

First observe that G < ||f|p since f G T, and it suffices to check that G > ||f|p. Suppose 
there exists tq G T such that (To,f) < ||f|p, which is equivalent to r := ((tq — f),f) < 0. 
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Consider the interval r(t) = f + t(ro — f), r(t) G T for all t G [0, 1], by convexity of T. We 
have, for t G (0, 1) small enough, 

" = ||f ||2 + 2tr + t^||ro - ff < \\ff. 



This contradicts to (17.511 . The lemma now follows. □ 



Return to the proof of the upper bounds. Let — )■ oo. Then, applying the Chebyshev 
inequality and ()7.3p we have, for — c«, 

a,(V^,,H) = PsAte >H)< ^^^^ ^ 0. 

For the alternative hypothesis, applying the Chebyshev inequality once again, (j7.4p and 
Lemma 1 7. H we have, for H = cus, c G (0, 1) and uniformly over r] G Q{rs), 

m..H.',) = P.,(*. < H) = p..„(kM-t. > ^M-H) < < - 0. 

This completes part (2) of the theorem. 

Let Ue X 1 and wq = o(l). Observe that = where is the statistic from the proof 
of the lower bounds, and it was shown that is asymptotically standard Gaussian under 
Pefi. This yields ae{tl>e,H) = ^{—H) + o(l). In order to evaluate type II error probability, 
let us divide the set 0(re) into two sets G^^i = {r/ G Q{r^) : h^{rj) < h^} and ©^^2 = 
{•q G : /ie(r?) > he}, where /ig — )• oo, h^wo — )• 0. Similarly to evaluation above, 

we get sup^^Q^ ^ /3eitpe,H,'n) ~^ fo^ H = 0(1). Let rj G ©e,i. By (j7.4p . we have 
Yaie^n'te = l + o(l). Observe that the statistics = {t^ — he{rj)) / ^yYaVs,rJte are asymptotically 
standard Gaussian under Pe,r]- This follows from Lyapunov's condition, since — he{r]) = 
X^fcgN^e.fc, where i^^k are independent and P^^^-distributed as Wk{Cl ~ 1 + '^VkCk), where 
Vk = Vk/^i S,k ~ -^(0, 1), A; G N. Therefore, one has, for some constant > 0, uniformly over 

Ee,r,il, < B{wl+wlvt), Y.{wl+wtvt) <wlY, wl+wl Wkvl\ < wl/2+wlhl ^ 0. 

fcGN fcGN VfceN / 

It also follows from the asymptotic normality of tg that, uniformly over 7] G ©e,i, 



MA,H,V) = PsAte <H)= Pe,^{ie < {H - hM) / V^^^^e) = HH - h,{r,)) + o(l). 
By Lemma |7. II and evaluation over r/ G 0^,2 above, we get 

P{e{re),i>e,H) = HH - inf h,{r^)) + o{l) = ^{H - Ue) + o{l). 

Taking H = H^"'^ and H = Us/2, it completes the upper bounds for part (1) (b) of the 
theorem. The theorem now follows. 



7.2 Proof of Theorem [^72 



Set A = m in (14. 4p : the quantity m = determines the efficient dimension in the 
problem. Then, the extreme sequence (14. 4p in the extreme problem (14. ip takes the form 



Vk 



z^k'^'^il- ik/mf'')+, l<k<m, (7.6) 
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while the equations for zq = zg.e; ^ = "t-s and take the form (j4.7p . ()4.8p . where 

m — ^ \m/ V \m/ / 

l<A,<m 

1 //i;x2Q+4/3/ //cN2ax 

= - E (-) (l-(-) )' 

l<fc<m 

Jo = Jl-J2 = - E (-) (l-(-) ) • 



m ^ — ' \m/ V \m 

l<k<m 

We consider the situation m — )• oo and — )• as e — )• 0. Let us now find the asymptotics 
of the sums Ji, J2 and Jq as m — )• 00. Replacing the sums Ji, J2 and Jq by integrals, after 
some calculations, we have, as m — )• 00, 

J 2a ^ 

' ^ (4/3 + l)(4/3 + 2a + l) ' 

J 2a ^ 

^ (4a + 4/3 + l)(4/3 + 2a + 1) ■ ^' 
, 80^ ^ 

° " (4/3 + l)(4a + 4/3 + 1) (4/3 + 2a + 1) • °- 

These yield 

r^~c?m"", n2~c2e-M^"^^''^^^^"> (7-7) 

where ci = (^1/(^2)^/^^°^ C2 = (d2/rfi)^^^+^^/^^"^do/(2d?). Hence, the value Ue of the ex- 
treme problem (j4.ip and the efficient dimensions m = satisfy 

~ e-2(^^/^)(4«+4/3+i)/2^ ^ ^ ci(£^n2/c2)-^/(^"+^''+^). (7.8) 

Observe also that, for the extreme sequence determined by (j7.6p . one has 



max i<fc<^ € < -S^o"-^^^ ^ ^-1/2 ^ Q ^ > Q_ 



Wo 



The theorem now follows on applying Theorem 14.11 



7.3 Proof of Theorem 473 



To prove the theorem, we need the following proposition. (Note that its validity is true for a 
wider class of sequences {afcjfcgN and {o"fc}fcgN, which cover all ill-posed inverse problems of 
interest.) 

Proposition 7.1 Let {ak}ke'M cL^d {(Tk}k&n be positive increasing sequences. Assume that 
there exists B > 1, a > 0, m = fhe G N, eo > such that, as < e < eo; 

2 

ar 

Teani+l > B, Us < „ ^ „ . (7.9) 

Set 

^ rh 

^m(??) = -77= hrh= inf hrhiv)- (7.10) 

k=l 



Then, there exists b = b{B, a) > such that km > bue as Q < e < sq. 
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Proof. By definition of O^, since tlie sequences {a^lfceN ^^nd {crfcjfcgN increase as A; — )■ oo, 
and by (j7.9p . we have, for r] G 6(re), 

m ^ rh ^ / oo \ l/ -j^oo \ 

k=l ™ k=l ^ \ k=m+l / ™ \ ™+l k=m+l / 

> ^f-?-3^1=4fl-I^l>¥> h = l-B-^>0. (7.11) 
Therefore, we have 



\ "m+1 / m \ ' e"'m,+l I " f, 



hrn > ^ , > bUe, b = b^/{V2a). (7.12) 

The proposition now follows. □ 

We are now ready to prove Theorem 14. 3i By the asymptotic normality of trh under Po,e 
as m — )• oo (see |l7j. Lemma 3.1), we have a(?/;£^H) = $(— if) + 0(1) — )• as H = ^ 00. 

In order to evaluate type II error probability for the test il^e,H, take /im(^) and hm as in 
(I7.10p . By the asymptotic normality of tm — hfhi'n) under P^^g as m — ?■ 00 (see [IT], Lemma 
3.1), we have 

(3e{4>e,H,r])<^H -h^{rj))+o{l), pe{4>e,H,Qe)<HH -h^) + o{l). (7.13) 

Proposition 17.11 implies that l3e{i^e,He-,Qe) —^0 as Hfr < (c + o(l))ne — )• oo, c G (0,6). 
The theorem now follows. 



7.4 Proof of Theorem 4-4 



We first consider the "standard" case q = 2. Let the efficient dimension m = be deter- 
mined by j4 = exp(— 2am) in (14. 4p . Then, the extreme sequence (14. 4p in the extreme problem 
(j4.ip takes the form 

f/^ = zgexp(2^fc)(l -exp(2a(A;-m)))+, 1 < A; < m, (7.14) 

while the equations for zq = zq^^, m = and Ue take the form (j4.7p . (|4.8p where 

Ji = ^ exp(4/3A;)(l - exp(2a(A: - m))), 

l<fc<m 

J2 = exp(— 2am) ^2 exp((2a + 4/3)A;)(l — exp(2a(/c — m))), 

l<fc<m 

Jo = J^- J^= J2 exp(4/3/c)(l - exp(2a(A: - m))f. 

l<k<m 

We consider the situation m — )• 00 and — )• as e — t- 0. Let us now find the asymptotics of 
the sums Ji, J2 and Jq as m — t- 00. After some calculations, we have, as m — t- 00, 

Ji X J2 X Jo ^ exp(4/3m) 
and, hence, using (j4.8p . we get the the relations 

r, X exp(-am)), x £-4^4{a+/3)/a^ (7 ^^5^ 
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Hence, the value of the extreme problem (j4.ip and the efficient dimensions m = rUf; satisfy 

n,xe-2exp(-2(a + /3)m), m = ^^f^^l^i^ + o(i). (7.I6) 

Hence, the "standard" case q = 2 for the theorem follows on applying Theorem 14. 1[ 

Consider now the "sparse" case q £ (0,2). The embedding ()4.17p yields 7(^,0g(r£)) < 
7(^,02(r£)). Therefore, it suffices to establish the lower bounds. Take m = max{k : 
r£exp{ak) < 1}, and consider the vector rjm that contains only one non-zero coordinate, 
the value z„ = r^ex.p{—f3n) at position m. One can easily check that ij^ G &q{^e) for any 
q € (0,2). Therefore, one cannot distinguish between Hq and Hi if z„ = o(e), which is 
equivalent to = o(r*), where r* is obtained by combining >c 1 and ()7.15p . In view of the 
above and the results for the "standard" case q = 2, the "sparse" case g = 2 for the theorem 
also follows. Hence, the theorem follows. 



7.5 Proof of Theorem 4-5 



We first consider the "standard" case q = 2. Let the efficient dimension m = rriir be deter- 
mined hy A = m~'^°' in (|4.4p . Then, the extreme sequence (j4.4p in the extreme problem (|4.ip 
takes the form 

4 = ziexp{2(3k){l-{k/mf'')^, 1 < k < m, (7.17) 
while the equations for zq = zo,e; ^ = "T-e and take the form (j4.7p . ()4.8p where 



Ji = 

l<k< 



J2 = 

l<k< 



Cfc<m V ^ ^ / 

Ck<m ^ ^ \ ^ ^ / 

Jo = Ji-J2= exp(4A;/3) [1 - . 

l<k<m \ ^ ^ / 

We consider the situation m — )■ cxd and — )• as e — )• 0. Let us now find the asymptotics 
of the sums Ji, J2 and Jq as m — t- 00. Take 5 > 0, 5^0, such that rn-(^ — t- 00, m5 S> 
log(m), m(5^ — 7- as m — 7- 00. Set k = m — I. Then, 



l<fc<m, 1=171— k 



2a 



5: 

m{l— 5)<fc<m, l=m—k 



2la 
m 

2a 



^ \ \ m 

l<fc<m(l-5), l=m—k 

:= exp(4m/?)(A + 5). 
For the term A, we have 

m(l— (5)<A;<m, l=m—k m(l— <5)<fc<m, l=m—k 
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Set t = exp(— 4/3). Then, the sum Ai can be rewritten in the form 

=^i(m,/3) =exp(-4/3)( ^ t'); x 1, 

m(l— (5)<fc<m, l=m—k 

where ()^ denotes differentiation with respect to t. Therefore, 

2a^i(m,/3) _ 

A = h Cfm j X m 

m 

For the term we have 

B= exp{-4lp)(l- (l- ) = 0(exp(-4/3m5)) = o(l/m'=), fc e N. 

l<fc<m(l-(5), l=m-k ^ 

Hence, combining the two terms, we get the asymptotics 

2aexp(4/3m)Ai(m,/3) _i exp(4/3m) 

Ji = ( i + C(m ) ) • 

m m 

For the asymptotics of J2, let us first rewrite it in the form 

4q , 



J2 = -Ji+ exp(4/3/c)(l-(A^ 



-Ji(q,/3) + Ji(2a,/3). 



The asymptotics of Ji{2a,(3) are studied similar to ones of Ji = Ji(a,/3), and we get 

J2 = 2am"ie^'^"^i(m,/3)(l + 0{m'^)) ~ Ji. 
For the asymptotics of Jq, we use the second order Taylor's formula to get 



1-- =1 + ^ — ^^ + o( — ]. 



Repeating the considerations that we used for Ji, I = m — k we have for 
4a2 . /,9 ^ / 1^' 

m(l— <5)<fc<m 



Jo = exp(4m/3)f^ ^ exp(-4//3) (^/^ ^ O (^^^ M + 0(exp(4m/3(l 



= exp(4m/3) j ^ exp(-4Z/3) + 0(m"^) j + o(exp(4m/3) m"^) 

\ m(l-<5)<A;<m / 

/4a2 \ _„ 

= exp(4m/3) — ^ + 0(m ) + o(exp(4m/3) m 

Taking derivatives as in the calculation of Ai, we get A2 = A2{m,P) x 1, which implies 

exp(4/3m) 



Jo 



Thus, using (j4.8p . we obtain the following asymptotics 

exp(4/3m) exp(4/3m) 2 -2a Z^. , "^o\ -2a , ^ 
Ji ~ J2 X , Jo X n , r^=m 1 + — =m In 

m 771^ \ Jl / V 771 
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and, hence, we get the relations 



r7V° = m + 0(l), <xe-V^exp(-4^r7^/"). (7.18) 
Hence, the value of the extreme problem (|4.ip and the efficient dimensions m = nie satisfy 



2 -4 -4a f A o\A /^n /l2^ 21og(e ^ ) - 2a log log(e ^) - {log{Ue) 

■u^ ~ e m exp(— 4mp)^2/(2^i), m~ — \- D, 

Zp 

(7.19) 

where D x 1 hold true uniformly over (a,/3) G S for any compact set S C (0, oo) x (0, oo). 
Hence, the "standard" case q = 2 for the theorem follows on applying Theorem 14. li 

Consider now the "sparse" case q G (0,2). In view of the embedding (|4.17|) . it suffices to 
establish the lower bounds. Take m = max{k : r^.k"' < l},m = r~^/" + 0(1), and consider 
the vector rjm that contains only one non-zero coordinate, the value z„ = exp(— /3n) at 
position m. One can easily check that r]m G Qq{re) for any q > 0. Therefore, one cannot 
distinguish between Hq and Hi if Zn = o(e), which is equivalent to 

Te/e = o(exp(-/3r-i/" + 0(1)). 

However, this is equivalent to Ue — )• 0, where Ue is determined by (j7.18p . In view of the above 
and the results for the "standard" case q = 2, the "sparse" case q = 2 for the theorem also 
follows. Hence, the theorem follows. 



7.6 Proof of Theorem 4-6 



Let the efficient dimension m = be determined by ^ = exp(— 2ma) in (j4.4p . Then, the 
extreme sequence ()4.4p in the extreme problem ()4.ip takes the form 



Vk 



z'^k'^^{l-exp{2a{k-m)))+, l<k<m, (7.20) 



while the equations for zq = zq^^, m = and take the form (j4.7p . (|4.8p . where 
Jl = ^ ^^'^(l -exp(-2a(m- A:))), 

l<fc<r?i 

J2 = ^ /c^'^exp(-2a(m- A;))(l -exp(-2a(m- A;))), 

l<k<m 

Jo = Jl - J2 = k^^{l - exp(-2a(m - k))f. 



l<k<m 



We consider the situation m — )• 00 and — )• as e — )• 0. Let us now find the asymptotics 
of the sums Ji, J2 and Jq as m — )• 00. We have 



Ji= Y - Yl k*^exp{-2a{m-k)) = A-B, (7.21) 



l<fc<m l<k<m 

where 



l<fc<m l<fc<m ^ ^ ^ 

Let us now evaluate the term B in the sum (I7.2ip . Let k = m — I. Then, 

B= Y k^'^ exp(-2a(m - k)) = m^^ Y " ^1^)^^ exp(-2aZ) = m^^ B^. 

l<k<m l<k<m, l=m—k 
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Let a > 0. Using the Taylor's formula, and since the series ^^-^ /'^ exp(— 2a/), k = 1,2, 
converges, we get 

l<fc<m, l=m-k ^ \ / / 

Therefore, combining the terms A, B and we get 

4^ + 1 

Similarly, for J2, letting k = m — I, we have 



Ji ~ ^^^^ . (7.22) 



J^ = m^^ iU--) )exp(-2a/)(l — exp(— 2q/)) X m'^^. (7.23) 

l<k<m, l=m-k \^ / 

By ([7:22]) and ([7:23]) . we have 

Jo = - J2 ~ Ji ~ cim^'^+S Jaxm^'^, (7.24) 
where ci = 1/(4/3 + 1). Hence using (|4.8p . we get the the relations 

r, X mi/2exp(-am), ~ di(r,/e) V-^^^+i) ~ d2(r,/e)4(logr-i)-(4'5+i), (7.25) 

where di = l/(2ci) and d2 = dia'^^'^^. Hence, the value of the extreme problem (14. ID and 
the efficient dimensions m = rrii, satisfy 



2 e-4g^p^_4Q,^)^-(4/3-i)^ m ~ log(r7i/"). (7.26) 



Observe also that, for the extreme sequence determined by (j7.20p . one has 

maxi<fc<m??^ Bzlm?P _i/2 „ 

WQ = - - < X m / ^ 0. 

Hence, the theorem follows on applying Theorem 14.11 
7.7 Proof of Theorem \4. 7 

In view of the embedding (I4.17p . we only need to consider the case q = 2. It was shown in 
the proof of Theorem 14.31 that a{ipe^H) — >• as if — t- 00. In order to evaluate the type II error 
probability, it suffices to consider only the case where Me(re(a,/3)) = o(log(e~^)), uniformly 
over (a,/3) G S. Similar to the proof of Theorem 14. 3[ we have the relation ()7.13p . and it 
suffices to evaluate the quantity 

^ in 

he{a,^)= inf ^rjl 

Since Dmi;{a, 13) > m > me(a, (3) and D = C{1 + o(l))/c > 0, we have 

he{a,l3) > dhlia,^), d = D-^/^{l + o{l)), 
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and 

^ m(a,^) 
h*(a,B) = : inf > nl, 

with rh{a,l3) = [me(a,/3)], where [a] is the integral part of a. By (j7.25p . the assumptions of 
Proposition 17. II are fulfilled uniformly over (a,/3) G S. In particular one can take a > such 
that (j7.9p holds true for all {a, 13) E S, as e is small enough. Applying now Proposition 17. 
we have hl{a,(3) > bu^^a,i3ifei<^i P)) ^ ^We(S). Therefore, we get he[a,j3) > 6itte(E) — oo, 

61 = hd. By (j7.13p . this implies that it suffices to take -ff^ — )• oo, Hf. < 62Ue(E) with any 

62 £ (0,61). The theorem now follows. 



7.8 Proof of Theorem 1478 



Before we prove the theorem we need the following result. 

Recall, that the extreme sequence (|4.4p in the extreme problem (|4.ip is of the form 

fil = zial{l-AalU, ken, (7.27) 

where the quantities zq = zq^^ and A = are determined by the equations 

and, thus, the value of the extreme problem (14. ip takes the form 



— A 

fcGN 



Consider now the following "truncated" version of the above system of equations 

^r Tf "2 ' -? = ^E^t (7.28) 
[ T.k=i'^kTk = ri, 2e4^ 

In order to solve the equations (|7.27p - ()7.28p . let us define a function r{A), A G (0,03^) as 
follows. Take m = ■m{A) G N, m > 2, such that a~+i < A < and set 

Then, for small enough, the quantity A = Ag, va. (I7.27P is determined by the equation 

re = r(^e). (7.30) 

Note first that r{A) is a positive continuous functions in ^ G (0, a^^). The following 
proposition ensures the existence of a unique solution in ()7.30p . (Note that its validity does 
not depend on the assumption (I4.20p .) 



Proposition 7.2 The function r{A) defined in ( 7.29) is strictly increasing in 
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Proof. Let a„+i < A < a^, m > 2. Introduce a probability measure P = {pi}i£i on the 
set / = {1, 2, . . . , m} such that pi = c^/X^/ILi "^fci i S /• Set 



H„M)={Y.<yUl{l-Aal)) 



2 

, m > 2. 



We consider a = {ajjjg/ as random variable on the set /. Then, we have 



Af 



(EfcLi OfcPfc - (Er=i (Avkf) (EfcLi 

>o, 



(Sp(a4) - {Ep{a')f) {Y.u=,<? _ Varp(a2)(Er=i^^)' 



where (•)^ denotes differentiation with respect to A. The proposition now follows. □ 

We are now ready to prove part (a) of the theorem. Let ^ = be the solution of (|7.30p . 
It then follows from (14.20p that 

{v-^ni— 2 2 2 ~2 2 2 ~2 m— 2 

y^™-2^2.2_^ _2 .2 2^^fc = ^or/™„i, (7.31) 

Z^fc=l cr^Vfc — ^2<Jm-l^m-l^ k=l 

where Ti = Tm,i{A), i = 0, 1, 2, are such that 

^m-2^m-2(l ~ ^'^m-2) /-.n ^m-2(l ~ ^'^m-2) /in /-.n qoN 

' ^ (1-Aa^ ) = ' ~ ^4 ^ _ ^^2 ^ = ^(l)' ^0 = (7.32) 

Therefore, we can rewrite the equations ()7.28p in the form 

2-2 , 2 -2 _ 2 U^=£ + Vm)/^^ (7-33) 



e ' 



with 6*, = 6m,i{^) = 1 + Tm,i(^) ~ 1, i = 0,1,2. Setting zi = r),^„_i, 2:2 = fj"^ we find 
z = (2:1,22) from (|7.33p : 

am^e - 1 ^2 - Q^-l^e^l 2 Ikf 

^1 //lO /I 9 \ 9 ' ^2 //lO /I 9 \ o) ^ 



We have ?7m = (this corresponds to vl = a"^) as = r^_i := a^_]Qm-\^ where by (j7.32p 
Qra-\ = ^m,2(flm^)/^m,i(flm^) > 1; ^m-i ~ 1- The Conditions zi > 0, Z2 > correspond to 

< r2 < a-2_i0„_i. (7.34) 

By (j7.32p and the definition of we have, as m — )• oo. 



^2 1 K ^ ^m-l Qm-l/Qm)(l Q'm-l/O'm+l) | ^2 ^ J_ 

Recalling the monotonicity of ^(^4), we see that if a,^j^x < < flm^, then = r(^£) G 
Am = [rm,rm-i] = [o-m i'^ + 0^^1(1 + o{l))], where > 0,"^ i = m - 1, m. 



44 



Let Ug^inin = minr^gA,„ Ue{re)- Thus, we get 

Ue{re) > Ue,mm (e^a^(T^)~^ as £ Am- (7.35) 
Let us now consider the interval = [^'m.i, n,i = l/o/- For G A^, we set 

Z = {Z1,Z2), Z* = {zl,Z^), 

Zl — //no n 1 ^2 ' ^2 //i9 /i2 \ 9' ^ev ej 



(^2«^ - 6'ia^~i)f^m~i ' (^2a^ -6*1 a^- 1)0-2,' ^ ^ = 

n2 7.2 1 1 _ II -v* II 



Zl — -r-5 2 r~2 ' ^2 — 2 r~9~' ~ '^eVel 



Note that, for some i? > 0, 

|n*(r2) - n*(ri)| < B(r| - rJ)/e2(T^_^, as r^,! < n < r2 < r^-i,!, (7.36) 
and it is easily seen that 

Ueire) ~ u*e{f£) as " ^ 0; ^'.^(j') > 'Ue(?') V r > 0. 
Also, for (5 = z — z and for G P| Aj^ = [r^, r^.i^i], we have 

||5|| = o((a^_ir^ + l)/a^o-^) = e^o(ne,min)- 
These yields, as G [rm,rm-i,i], 

Ue{re) u^ire) = ^=—— -3 + . (7.37) 

Let re G [rm-i,i, -Tm-i] C A*,_;l. Observe that 

< U*{re) - UeiVe) < U*(rm_i,i) - Ue{rm-l,l) + K('^e) - 'U*(?'m-l,l)l = 6 + 6, 

where = u*(r^_i,i) - ^^(r^-i,!), ^2 = Kirs) - ul{rm^i^i)\. By (17.371) . 

= o('U£(rm_i,i)) = oiueire)). 
Applying ()7.36p for the interval A*^_i we get 



6 <5 



^2 rt-»2 

m— 1 m— 1,1 



"m-2 

Sinc e r^ i - r^_i^i = (e'm-.i - l)/a^_i, using (|7.32p, we have 6*^-1 - 1 = 0((t^_2/o-^_i). 
By (I7:35|) . these yield 



cr. 



^2 = 0( " _^ ) = o(Ue(r.)), 



''m-l'^m-l . 

as re G A^_^. This completes part (a) of the theorem. 

We now prove part (b) of the theorem. For r G Ajl^, m G N, m > 2, consider the piecewise 
linear (in r^) function ne"(r) defined in ()4.22p . We then have, at the break points, 



1 N 1 



U^ni/am) = 2 2 2 ' 4'"(l/«m-l) = ,2^2 " (7-38) 



Using the standard inequalities (x + y)/^/2 < yx^^+y^ < x + y, x > 0, y > 0, we get, for 
r > small enough, 

nf(r)/2<<(r)<nf(r)/^/2. (7.39) 

Part (b) of the theorem follows by (j7.39p and part (a) of the theorem. 

Parts (c) and (d) of the theorem follow immediately by combining Theorem 14.11 and part 
(b) of the theorem. The theorem now follows. 
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7.9 Proof of Theorem \4. 9 



For type I error probability, we have 

m m 

a{llJe,a) = PeAys,a) < ^Pe,o(|?/fe| > T^.fe^) < 2 J]] «>(-T^,fe) = a. 

k=l k=l 

In order to evaluate type II error probability, observe that 

/3{'ipe,a,'n) = P£,r,{ye,a) < mill Pe,ri{\yk\ < T^^ke) < ^( min {Tm,k " £:'^r]k)), 

l<A;<m l<k<m 

and it suffices to check that 



inf max (e 'r]k-T^,k)] ^ oo as urC^^e) ^ oo, G A;,. (7.40) 

The following proposition is useful to our goal. 

Proposition 7.3 Let assume 1^4. 20 ) holds true. Let G A^, consider the collection 
Hm,k^ 1 < A; < m satisfying < -f^m.fc ^ Bi{m — k + 1)^"^ for some Bi > 0, I = 1,2 if 
1 < k < m — 2 and Hm,m = Hm,m-i = 1- Then 

inf max H;;^\ri> u^r{re){ll {2^) + o{l)). 

r]£&(re) l<k<m ' 



Proof. Let r] E 0(re), take 



r^,=^ + ^, tG[0,l], (7.41) 



and suppose that 

max e-^H;^\ri<u'^-{r,). 

l<fe<m— 2 ' 

On noting that u^™, in view of (|7.4ip . takes the form 

(r) = l~\ + ^ ^ ^ a , t e [0, 1], 



m— l"m— 1 



we then get 

m— 2 m— 2 



f l-t t \ 



2 



Set f/ = (0, . . . , 

, ?7ni~i)^m) . . .). It follows from the estimation above that f/ E ©(f^), 
— b6 for some 6 > 0, and 



Ue{fe) > (r.)(l/2 + 0(1)) > (1/2 + 0(1)) (re) 



n-2 p2 



1 A _ ) ^ (r,)/2 > ^,(r,)(l/V2 + o(l)). 



This implies 

oo 



fcGN k=m-l 
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Since Y^keN^'l'^k^k - 1' ^^^^ % - ("fc^fc) ^ and 



% < 2^ (OfcCTfe) < (arn+icrm+i) 2^ -g 

; I 1 ; I 1 J 1 1 [O'k'^k) 

fe=m+l k=m+l k=m+l 

~ {am+icrm+i)~^ = o{e^u^{rs)). 

Thus, for m large enough, 

e-4max(r?^_i,r/^) > e-\vi^, + vi)/2 > n2(r,)(l/2 + o(l)), 

which yields e'"^ max{r]l^_^,r]'^) > Ue{re){l/V2 + o{l)) > n'*"(r£)(l/2^/2 + o(l)). The propo- 
sition now follows. □ 

We are now ready to complete the proof of the theorem. Note that T^^k ^ — ca) 

are bounded away from 0. The collection Hm,k = {Tm,k/Tm,m)'^ satisfies the assumption of 
Proposition 17.31 since 



Applying now Proposition 17.31 to this collection we get that there exists k, 1 < k < m such 
that 

e-^m > ^-^'\Trn,k/Trn,rn)\pf{j^){l+o{l)), 

which yield 

max {e^^rik — T^^k) oo as v}^^{rs) — )• oo. 
This implies (|7.40[) . The theorem now follows. 

7.10 Proof of Theorem{57l\ 

We first obtain the lower bounds. Take a collection ki such that 

(6 - a) log(3) 



{ki) = a + l6e, I <l < L = Le, (t>{KL) =b, S = Se 



L log(e-i)' 



Assume, without loss of generality, that Us{ki) x log log (e ^) uniformly in / = 1, 2, . . . , L. 
Observe that log(L) ~ loglog(e~^). Set 

m,~(e(loglog(5-i))'/y^^'^'\ (7.42) 

By construction, we have 

mi - mi_i ~ (^exp (^(5 log (^e^^ (log log(e"^)) ^^^^^ - 1^ 

= mz_i(3(l + o(l)))-l)~2mz_i. 

Set 

Ai = {A: G N : m,_i <k< mi}, Mi = #iAi)2 ~ mi-i. (7.43) 
Take a collection zi > such that 

zfMial^ {Ki)al^ {ki) = 1, 1<1<L. (7.44) 
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By (|7.7p . (j7.8p . the relation ()7.44p implies that, as the quantity d in Theorem 15. II (a) is small 
enough (this corresponds to ^^(k) small enough), one has 

z^Mial^^^{Ki)>rl{tii), 1<1<L. (7.45) 

Set uf = Mizf/{2£^). Observe that the relations ([7^ . ([7^ . fTiHI) imply 

uf ~ 31oglog(e-i)/4 X uliKi), (7.46) 

Therefore the relations zf = 2£^v?jMu ([731]), (I7:i6]) and imply 

2i = o(e). (7.47) 

Consider the priors 



fceA, Z=l 

where {efcl^g^ is the standard basis in and 5^ is the Dirac mass at the point r/ G The 
relations fTii]) . fTiS]) imply, for d = d(S) small enough, 7r/(e«;, (r£(Ki))) = 1, 7r(G(S)) = 1. 
Let Ptt; = -E'TTj and P^r = Et^P^^^^ be the mixtures over the priors. It suffices to check that 

Ee,o ({dP^/dPefl - if) = o(l). (7.48) 
Using evaluations similar to [T7] (see formulae (3.64)-(3.69)), we have 

E,^Q {{dPjdPefl - if) = JlY. ^-'0 {{dP.JdP,,o - if) 

1=1 

L 



-1 Yl (^^.0 {dp.,m,of - 1) < ^ E - 1) ' 
1=1 1=1 



where uf = 2Mi sinh2(z2/(2e2)) uf by dTIiTll . By (TTIiGll one has 

max/ u} , , , 

~ 3/4 < 1. 7.49 

log(L) 

This yields (j7.48p and completes part (a) of the theorem. 

We now obtain the upper bounds. Recall that we have, in Theorem 15.11 (b), L,. = 
o(log(e~^)), — )• oo. It follows from the exponential inequality for x^-statistics that 

log(Pe,o(tm > H)) < -H^/2{1 + o(l)) as = o{^), ^ oo, (7.50) 

see, e.g., (5.22) in [18j. This implies that, for the type I error probability, 

oo oo 
l=L^ l=L^ 

Let us evaluate the type II error probability. It suffices to consider the case = 
Z)yloglog(e^^ with D larger enough. Observe that (see ()7.13p ) 

f3s{A,ri) < mmP,^r,itmi < Hi) = mm '^{Hi - (r/)) + o(l). 
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where hm{r]) is determined by (|7.10p . Therefore uniformly over k G S, 

/3e(V'e, ^(\/CMogL- max/i„;(K)) + 0(1), h^^{K) = inf /im,(r?). 

For K G S, let us set ms{K) = (e^^ log log(e~^))^/(^°"'"^^"^-'^) and take I such that mi_i < 
mein) < mi, i.e., 

m, = cm,(^), CG(1,2], ^ ~ (4^-^^^%!^ > ^e- 

It follows from (|7.7|) . (|4.11|) that, for L> = D^axC^) larger enough, re{K)a„ii+i{K) > B + o{l), 
with B = B{T,) > 1 that could be taken common for all k S S. It follows from (j4.1ip that the 
assumptions of Proposition 17.11 are fulfilled for m = m/ with some a(S) = sup^g^ o(k) > 0, 
uniformly over k gT,. Applying Proposition 17.11 one can take b = b{T,) such that, uniformly 
over K £ Ti, h^^iK) > bue{K.). Thus, it suffices take D{T,) > max{Dmaxi'^):C/b{T,)). This 
completes part (b) of the theorem. 

Part (c) of the theorem follows immediately in view of parts (a) and (b) of the theorem 
and ()7.7p . The theorem now follows. 



7.11 Proof of Theorem\5lE 

We first obtain the lower bounds. Take a collection ki such that (p{K.i) = + 15^, 1 < ^ < 
L = Lgr, 4>{i^l) = be, where a < ae < be < b, Og = a + o(l), be = b + o(l) and take L such 
that 

be - ae 2 

Oe — ~ , 

L 21og(e^i) — log log log (e^i) 

mi = [<^(Ki)(21og(e-i) -logloglog(e-^) -log(c))] G N, c < exp(-l/2), 

where [a] is the integral part of a. By construction, mi — m;_i ~ 2. 

Applying (17.15p . we see that, if Ue{K) < dlog log(e~-'^) for all k G S and some d> 0, then 
u*e{n) = 5-2^2(a(K)+/3(K))/o(K) ^ fi;^ fog log(e^"'^ ) for all K G S and some di. Observe that, for 
any c > from the definition of mi above, one can take d small enough (this corresponds to 
re{n) small enough) such that di < c. This yields 

exp{-aimi) > re{Ki). (7.51) 

For Ki G S, let us take zi = rjiemn where rji = exp(— (q; + /3i)mi) and {e/}/gN is the standard 
basis in P. By (I7.51j) this yields r]i G re(K/)) for any q = qi > 0. Let us consider the 

prior 

1 ^ 

1=1 

and the mixture P^- over vr. Since 7r(0£(S)) = 1, it suffices to verify that (see [IT], Section 
2.5.2, Propositions 2.11, 2.12) 

Ee,oidPjdPe,o - if ^ 0. (7.52) 

One has 

L L 

Ee,o{dPjdPe,o -lf = J^Yl Ee,o{dPe,zJdPe,o - = Jl " ^^'^^^ 

1=1 1=1 
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The relation (j7.52p holds true as L x log(e ^) and for c small enough 

max rjf /e^ < clog log(e~"'^) sup exp(2(a/ + /?;)) = ci loglog(e~"'^), ci < 1. (7.54) 

Thus (I7.54|) holds true under the assumption of the theorem for d small enough. This 
completes part (a) of the theorem. 

In order to obtain the upper bounds, we need the following (general) proposition and its 
corollary. 

Proposition 7.4 Let h = {6j}igN oind c = {cjjjgN positive sequences, b = {feijigN be an 
increasing sequence, 6j — )■ oo and Cibi — )• oo as oo. Let also r > be a small enough 
quantity and let X = {x\ x = {xjjjgN} be a set of sequences x = {xjjjgN that are determined 
by the constraints 

biCiXi < 1, CiXi > r, Xi > y i £ N. 

ieN ieN 

Consider the extreme problem 

w = w{r) = inf </>(x), <j){x) = supxj. 

Then, the extreme sequences x* = {x*}i^fq such that (f){x*) = w is of the form: 

x\ = w, i = 1,2, . . . ,m — 1, x'!^ = wo, Xi = as i > m, 
where the quantities w and wq, < wq < w, are of the form 

rbyn-l Ci(l - r6i) 

W = , Wq = , 

Yli=l '^ii^m - bi) Cm Y.T=1 ^ii^rn " &i) 

and the integer m is determined by the inequalities 

Bm<r<Bm-i, Bk = ^^^^, k = l,2,...,m. (7.55) 

One further obtains the inequalities 

Cni<w<Cm-i, Ck = —^ , k = l,2,...,m. (7.56) 

Ei=i biCi 

Proof. In order to find a minimum of a convex function defined on a convex set X, we 
use the methods of sub-differentials (see [27j). Consider X and <j) as in the statement of the 
proposition, and let x & X. Then, the structure of X implies that limj_j.oo Xi = and there 
exists i £ N such that Xj > 0. 

Let as consider the sets L{x) consisting of the indices z E N such that Xi = supj^p^Xi. 
Then /(x) 7^ 0, x £ X, and for i G /(x) we have Xj > 0. The sub-differential of the convex 
function (p{x) = supj Xj consists of sequences d = {di}i(z^ such that > 0, z G N, = 
for i ^ /(x), and Y^ieN^-i = 1 (see Lemma 1 in Section 1.4.1 of [27]). We get the following 
relations for the extreme sequence x*: 

di = \ci - ^Cibi + Ei, z G N, 
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where A > 0, ^ > and dj, Sj, i G N, are non-negative quantities such that: if A > 0, then 
I^ieN '^i^i = r; if > 0, then XlieN ^iCiX* = 1; if z ^ H^*), then = and x*ei = 0, z G N, 
SieN ^« ~ These relations are possible if A > 0, /i > only, and it can be rewritten in the 
form 

di = Aq(1 - bi/B) +ei, i G N, B > 0. 

Since 6, > increases in i G N, and bi — )• oo, as i — )■ cx), then > 0, e, = 0, i G N, 
X* = supjgjsjXj := -u; > as i < m — 1, where m = m{B) = max{i : bi < B} and x* = as 
i > m. The quantities B and x^ := wq are taken such that bm = B, dm = £m ^ 0, 



m— 1 m— 1 

If; 

i=l i=l 



^iCj + WobmCm = 1, ""^ ^ Q + l^OCm = ^ < tfo < 



The proposition now follows. □ 

Corollary 7.1 iei = exp(a/i;) and = exp(/3/c), /c G N, a > and /3 > 0. Lei 
Te > 0, rg — 5- 0. S'ei m = — (logr£)/a + 0(1). Then, for mi = m + c and c > large enough, 
one has 

inf max rjf x exp(— 2m(a + /3)) x e^iig. 

7?G©{re) l<i<mi 

Proof. We apply Proposition 17.41 to i = ke'N,bi = af,Ci = af,Xi = rif,X = Q{rs) and 



r 



r2. It then follows from ([7351) . ([736]) that 



inf supr/j^ X exp(— 2m(a + m = ^ + 0(1). 

Therefore and by (j7.15p we have exp(— 2m(a + /3)) x 7-^("+'')/'^ x e^Ug. It suffices now to 
check that we can replace supjgpj by maxj<m^ for mi = m + c and c > large enough. This 
follows immediately from the inequalities afafrjf < 1, i G N. This completes the proof of the 
corollary. □ 



We are now ready to obtain the upper bounds. One has 

oo oo ^ oo 



1=1 tii^/'V^) 

Let us now evaluate the type II error probability. In view of the embedding (j4.17p . it suffices 
to consider the case q = 2. We have 

l3e{A,r]) < inmPe,rj{\yi\/e < Hi) < mm^{Hi - hl/e)- 

It suffices to verify that, uniformly over k G S, 

inf max(r/f/£2 - Hf) ^ oo. (7.57) 

»?G6e(K,rE(K)) I 



We apply Corollary 17.11 Since 

21og(e-i)-log(tx,) + 0(l) 



m 



0(log(e-^)) 



2(a + /3) 

and, as L < I < mi = m + c, c = 0(1), 

Hf = Clog(/) < C71og(mi) < Cloglog(e-i)) + 0(1), 
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it follows from Corollary 17.11 that 

inf max(7/f/e^ — Hf) > inf max{r]f /e'^ — Hf) > bue — C log log (e""*^) —?- oo, 

as liminf ne/loglog(e~^) > D, for D large enough. This completes part (b) of the theorem. 

Part (c) of the theorem follows immediately in view of parts (a) and (b) of the theorem 
and (|7.15p . The theorem now follows. 

7.12 Proof of Theorem \5IM 

We first obtain the lower bounds. Set H = (e^ log^"(e~^) log log(e^^))^^. Take a collection 
Ki = {a,f3i) G S such that 

1 21 1 

- = 2a, + -— -, l<l<L = Le, — = 2be, 
A log{H) 13 L 

where L x \og{H) ~ 21og(e~^), and a < a, < 6, < 6, a, = a + o(l), 6, = & + o(l) are taken 
in such way that mi = \og{Ha~'^°') /2f3i G N. By construction, we have m/ — mi^i = 1 and 

m-2"exp(-2/3zm0 ~ (aA)^V log log(e~i) < 2'^''e^ \og\og{e-^){l + o{l)). (7.58) 

Assume, without loss of generality, that Ue{ni) x log log (e"-*^), uniformly in / = 1, 2, . . . , L. 
Taking into account ()7.18p and ()7.19p . we can assume that, for d small enough (this corre- 
sponds to re{K) small enough), 

m;-" > Teini). (7.59) 

For I = 1,2, ... ,L, let us take rji = zie-mi, where zi = m^~" exp(— /S/m^) and {e^jigN be the 
standard basis in t^. By (j7.59p . this yields rji E G)e{i^l) for any q = qi > 0. The following 
steps are along the lines of the proof of part (a) of Theorem 15.21 We consider the prior 

1 ^ 

1=1 

and the mixture Pt^ over the prior vr. Since 7r(0($])) = 1, it suffices to verify (j7.52p . By 
()7.53p . this relation holds true as 

maxi</<r z?/e'^ 

lim sup \--,Z, < 1 . 7.60 

log(L) 

By construction, we have log(L) ~ log log (e^-*^), and by (|7.58p . zf/e"^ < 2^^" log log(e~^)(l + 
o(l)). This implies (I7.60p . This completes part (a) of the theorem. 

In order to obtain the upper bounds, we need the following corollary. 

Corollary 7.2 Let at = A;" and ak = ex.p{(3k), /c G N, a > 0, /3 > 0. Let > 0, 0. 
Set m = r~" + 0(1). Then, for mi = m + c and c > large enough, one has 

inf max r/^ x m^'^" exp(— 2m/3)) x e^n,, as mi > m. 

7?e©(re:) l<i<mi 

Proof. The first rate relation follows from Proposition 17.41 and is similar to the proof of 
Corollary 17. H the second one follows from ()7.19p . This completes the proof of the corollary. 

□ 

We now obtain the upper bounds. In view of the embedding (j4.17p . it suffices to consider 
the case q = 2. We work along the lines of the proof of part (b) of Theorem 15.21 and apply 
Corollarv 17.21 ()7.18p and ()7.19p . This completes part (b) of the theorem. 

Part (c) of the theorem follows immediately in view of parts (a) and (b) of the theorem 
and (I7.18p . The theorem now follows. 



52 



7.13 Proof of Theorem \5. 4 



We first obtain the lower bounds. By making re(K) larger, we can assume, without loss of 
generality, that C = 1, i.e., for all k G E, 



and, some d > 0, 4*"(S)/loglog(e-i) = d. Taking = (eV^lfH^)"^ find a collection 
f^h 1 < I < M = Adf, X M{Af,, S) such that, for m(^e, ki) = mi, one has 

\mi -mk\ > 1, V A;,Z = 1,...,M, / re(«;;) G A;:;^^. 

Observe that loglog(Ae) ~ loglog(e~-'^) and that, by (15.13p . 

log(M(yle,S)) ~ log(M), liminflog(M)/loglog(e"i) = 5 > 0. 

For each / = 1, 2, . . . , M, take ti G [0, 1] such that 



Let us now consider a collections of vectors r/' = (0, 0, . . . , 0, ffmi-i^Vmi > 0) 0) • • •) with 



One can easily check that rf G (r£(K;)) and 

e-2||^'||2=^,'-(r,(K0)=nf (S), (r?', 77^) = 0, V A;, / = 1, 2, . . . , M, A;//. (7.61) 

We now work along similar lines of the proof of part (a) of Theorem 15.21 We consider the 
prior 



1 *^ 

M ^ 



1=1 



and the mixture over vr. Since 7r(0e(S)) = 1, it suffices to verify (j7.52p . Similarly to 
(1733]) . one has, by (USB), 



M 



Eefl{dP./dPe,o - If = M-2^(exp(||r/^||i/e2) _ l) = M'^ exp(4-(S)). 

Z=l 

Therefore, the relation ()7.52p holds true as 

hmsup , , , ' < 1. 
log(M) 

By ()5.13p . it suffices to take d G (0, h). This completes part (a) of the theorem. 
We now obtain the upper bounds. First, by (|5.14p . we have 

00 00 
a{il^e) < PeM/e > T,^k) = 2Y,H-Te,k) = o{l). 

k=l k=l 
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Next, let ry G We have 

/3,(V.,r?) < inf P,,^(|yfc|/e < Te,k) < HM^^''' " 
and it suffices to check that, uniformly over k € S and r] € ©^^^('^el'^))) 

sup(e~^|?7fc| - Te^fc) oo. (7.62) 
fceN 



Let m = m{Ai;^f^,K) where 74^^^ = v}^^{k, re(K))) We have r£(K) E AJ^. Since the 
sequence T^j^. ~ 21og(/c) increases in k, the relation ()7.62p follows from 

hminf >2. (7.63) 

max(r|,21og(m)) ^ ' 

Applying Proposition 17.31 to the collection Hm,k = 1, A; = 1, 2, . . . , m, we have 

max e~Wk > r,(K)) (1/(2^2) + o(l)) > nf (S)(1/(2V2) + o(l)). 

l<K<m 

Also, since m(A, k) increases in A, and j4e_K < Me where = (^A/log log(e^i))^-'^, we have 

21og(m) < 2L{bAe,T.) < 25 log log(e"^)(l + o(l)), < loglog(e"^). 

Therefore, the relation (f7:63|) holds true as u^*"(S) > D log log(e~^), for D > 2^/2 max(25, 1). 
This completes part (b) of the theorem. 

Part (c) of the theorem follows immediately from parts (a) and (b) of the theorem and 
the definition r^'^[K). The theorem now follows. 
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